Apple updates App Store guidelines to ban bait-and-switch nudify apps and AI-generated offensive content
Apple tightened its App Store developer guidelines over the weekend to ban apps that use AI to create offensive content. The update also targets apps that pass review as ordinary apps and later turn into nudify apps or surface those features prominently (a bait-and-switch tactic). Apps hosting user-generated content must filter objectionable material, let users report offensive content and let them block abusive accounts. Apple will remove apps that add features not present in the version submitted for review, and it reinforced its legal-section language barring apps that promote human trafficking and child exploitation. The change follows pressure from the City of San Francisco (City Attorney David Chiu) in July and an April Tech Transparency Project report that found multiple nudify apps in the Apple and Google stores, some rated as suitable for minors.
Detalhes técnicos
- The abuse pattern is app-review evasion: a benign-looking app is submitted and approved, then harmful capabilities such as "nudification" are enabled or promoted after approval.
- Apple said that last year its review process blocked over 150,000 apps from reaching users and removed 193,000 developer accounts for fraud and abuse.
Remediação
- Developers must document all features, avoid hidden or undocumented functionality, and implement content filtering, reporting and blocking for user-generated content.
- Apple will remove apps that add undisclosed features after review.
Linha do tempo
-
Apple updates App Store guidelines to ban bait-and-switch nudify apps and AI-generated offensive content
ler a análise desta fonte ocultar
Apple tightened its App Store developer guidelines over the weekend to ban apps that use AI to create offensive content. The update also targets apps that pass review as ordinary apps and later turn into nudify apps or surface those features prominently (a bait-and-switch tactic). Apps hosting user-generated content must filter objectionable material, let users report offensive content and let them block abusive accounts. Apple will remove apps that add features not present in the version submitted for review, and it reinforced its legal-section language barring apps that promote human trafficking and child exploitation. The change follows pressure from the City of San Francisco (City Attorney David Chiu) in July and an April Tech Transparency Project report that found multiple nudify apps in the Apple and Google stores, some rated as suitable for minors.
Technical Details
- The abuse pattern is app-review evasion: a benign-looking app is submitted and approved, then harmful capabilities such as "nudification" are enabled or promoted after approval.
- Apple said that last year its review process blocked over 150,000 apps from reaching users and removed 193,000 developer accounts for fraud and abuse.
Remediation
- Developers must document all features, avoid hidden or undocumented functionality, and implement content filtering, reporting and blocking for user-generated content.
- Apple will remove apps that add undisclosed features after review.