Synthetic human-like fakes: Difference between revisions

Jump to navigation Jump to search
→‎Countermeasures against synthetic human-like fakes: California Senate Bill SB 564 is the one that actually passed. AFAIK it was originally identical copy of the Assembly Bill 602 + linking the amended version
(→‎Countermeasures against synthetic human-like fakes: California Senate Bill SB 564 is the one that actually passed. AFAIK it was originally identical copy of the Assembly Bill 602 + linking the amended version)
(45 intermediate revisions by the same user not shown)
Line 1: Line 1:
<section begin=definitions-of-synthetic-human-like-fakes />
<section begin=definitions-of-synthetic-human-like-fakes />
When the '''[[Glossary#No camera|camera does not exist]]''', but the subject being imaged with a simulation of a (movie) camera deceives the watcher to believe it is some living or dead person it is a '''digital look-alike'''.
When the '''[[Glossary#No camera|camera does not exist]]''', but the subject being imaged with a simulation of a (movie) camera deceives the watcher to believe it is some living or dead person it is a '''[[#Digital look-alikes|digital look-alike]]'''.


When it cannot be determined by human testing or media forensics whether some fake voice is a synthetic fake of some person's voice, or is it an actual recording made of that person's actual real voice, it is a pre-recorded '''digital sound-alike'''.  
When it cannot be determined by human testing or media forensics whether some fake voice is a synthetic fake of some person's voice, or is it an actual recording made of that person's actual real voice, it is a pre-recorded '''[[#Digital sound-alikes|digital sound-alike]]'''.  
<section end=definitions-of-synthetic-human-like-fakes />
<section end=definitions-of-synthetic-human-like-fakes />


Line 65: Line 65:
}}</ref>
}}</ref>


{{Q|Do you think that was [[w:Hugo Weaving]]'s left cheekbone that [[w:Keanu Reeves]] punched in with his right fist?|Trad|The Matrix Revolutions}}
{{#lst:Quotes|MatrixTrad}}


=== The problems with digital look-alikes ===
=== The problems with digital look-alikes ===
Line 72: Line 72:


These industrially produced pornographic delusions are causing great humane suffering, especially in their direct victims, but they are also tearing our communities and societies apart, sowing blind rage, perceptions of deepening chaos, feelings of powerlessness and provoke violence. This '''hate illustration''' increases and strengthens hate thinking, hate speech, hate crimes and tears our fragile social constructions apart and with time perverts humankind's view of humankind into an almost unrecognizable shape, unless we interfere with resolve.
These industrially produced pornographic delusions are causing great humane suffering, especially in their direct victims, but they are also tearing our communities and societies apart, sowing blind rage, perceptions of deepening chaos, feelings of powerlessness and provoke violence. This '''hate illustration''' increases and strengthens hate thinking, hate speech, hate crimes and tears our fragile social constructions apart and with time perverts humankind's view of humankind into an almost unrecognizable shape, unless we interfere with resolve.
For these reasons the bannable '''raw materials''' i.e. covert models, needed to produce this disinformation terror on the information-industrial production pipelines, '''[[Law proposals to ban covert modeling|should be prohibited by law]]''' in order to protect humans from arbitrary abuse by criminal parties.


=== List of possible naked digital look-alike attacks ===
=== List of possible naked digital look-alike attacks ===
Line 92: Line 90:
=== Temporal limit of digital look-alikes ===
=== Temporal limit of digital look-alikes ===
[[File:Institut Lumière - CINEMATOGRAPHE Camera.jpg|thumb|left|120px|A picture of the 1895 [[w:Cinematograph]]]]
[[File:Institut Lumière - CINEMATOGRAPHE Camera.jpg|thumb|left|120px|A picture of the 1895 [[w:Cinematograph]]]]
[[w:History of film technology]] has information about where the border is.


Digital look-alikes cannot be used to attack people who existed before the technological invention of film. For moving pictures the breakthrough is attributed to [[w:Auguste and Louis Lumière]]'s [[w:Cinematograph]] premiered in Paris on 28 December '''1895''', though this was only the commercial and popular breakthrough, as even earlier moving pictures exist. (adapted from [[w:History of film]])
Digital look-alikes cannot be used to attack people who existed before the technological invention of film. For moving pictures the breakthrough is attributed to [[w:Auguste and Louis Lumière]]'s [[w:Cinematograph]] premiered in Paris on 28 December '''1895''', though this was only the commercial and popular breakthrough, as even earlier moving pictures exist. (adapted from [[w:History of film]])


[[w:History of film technology]] has more precise information about where the border is.
The '''[[w:Kinetoscope]]''' is an even earlier motion picture exhibition device. A prototype for the Kinetoscope was shown to a convention of the National Federation of Women's Clubs on May 20, 1891.<ref name="memory.loc.gov">
 
{{cite web
|publisher=[[w:Library of Congress]]
|website=Memory.loc.gov
|url=http://memory.loc.gov/ammem/edhtml/edmvhist.html
|title=Inventing Entertainment: The Early Motion Pictures and Sound Recordings of the Edison Companies
|access-date=2020-12-09
}}
 
</ref> The first public demonstration of the Kinetoscope was held at the [[w:Brooklyn Museum|Brooklyn Institute of Arts and Sciences]] on '''May 9''', '''1893'''. ([[w:Kinetoscope|Wikipedia]])<ref name="memory.loc.gov"/>
 
 
----
----


Line 103: Line 115:
Living people can defend<ref group="footnote" name="judiciary maybe not aware">Whether a suspect can defend against faked synthetic speech that sounds like him/her depends on how up-to-date the judiciary is. If no information and instructions about digital sound-alikes have been given to the judiciary, they likely will not believe the defense of denying that the recording is of the suspect's voice.</ref> themselves against digital sound-alike by denying the things the digital sound-alike says if they are presented to the target, but dead people cannot. Digital sound-alikes offer criminals new disinformation attack vectors and wreak havoc on provability.  
Living people can defend<ref group="footnote" name="judiciary maybe not aware">Whether a suspect can defend against faked synthetic speech that sounds like him/her depends on how up-to-date the judiciary is. If no information and instructions about digital sound-alikes have been given to the judiciary, they likely will not believe the defense of denying that the recording is of the suspect's voice.</ref> themselves against digital sound-alike by denying the things the digital sound-alike says if they are presented to the target, but dead people cannot. Digital sound-alikes offer criminals new disinformation attack vectors and wreak havoc on provability.  


For these reasons the bannable '''raw materials''' i.e. covert voice models '''[[Law proposals to ban covert modeling|should be prohibited by law]]''' in order to protect humans from abuse by criminal parties.


=== Documented digital sound-alike attacks ===
=== Documented digital sound-alike attacks ===
Line 133: Line 146:


=== 'Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis' 2018 by Google Research (external transclusion) ===
=== 'Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis' 2018 by Google Research (external transclusion) ===
 
<section begin=GoogleTransferLearning2018 />
* In the '''2018''' at the '''[[w:Conference on Neural Information Processing Systems]]''' (NeurIPS) the work [http://papers.nips.cc/paper/7700-transfer-learning-from-speaker-verification-to-multispeaker-text-to-speech-synthesis 'Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis'] ([https://arxiv.org/abs/1806.04558 at arXiv.org]) was presented. The pre-trained model is able to steal voices from a sample of only '''5 seconds''' with almost convincing results
* In the '''2018''' at the '''[[w:Conference on Neural Information Processing Systems]]''' (NeurIPS) the work [http://papers.nips.cc/paper/7700-transfer-learning-from-speaker-verification-to-multispeaker-text-to-speech-synthesis 'Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis'] ([https://arxiv.org/abs/1806.04558 at arXiv.org]) was presented. The pre-trained model is able to steal voices from a sample of only '''5 seconds''' with almost convincing results


Line 141: Line 154:


The Iframe above is transcluded from [https://google.github.io/tacotron/publications/speaker_adaptation/ 'Audio samples from "Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis"' at google.gituhub.io], the audio samples of a sound-like-anyone machine presented as at the 2018 [[w:NeurIPS]] conference by Google researchers.
The Iframe above is transcluded from [https://google.github.io/tacotron/publications/speaker_adaptation/ 'Audio samples from "Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis"' at google.gituhub.io], the audio samples of a sound-like-anyone machine presented as at the 2018 [[w:NeurIPS]] conference by Google researchers.
<section end=GoogleTransferLearning2018 />


=== Digital sing-alikes ===
=== Digital sing-alikes ===
The to the right [https://www.youtube.com/watch?v=0sR1rU3gLzQ video 'This AI Clones Your Voice After Listening for 5 Seconds' by '2 minute papers' at YouTube] describes the voice thieving machine presented by Google Research in [[w:NeurIPS|w:NeurIPS]] 2018.
{{#ev:youtube|0sR1rU3gLzQ|640px|right|Video [https://www.youtube.com/watch?v=0sR1rU3gLzQ video 'This AI Clones Your Voice After Listening for 5 Seconds' by '2 minute papers' at YouTube] describes the voice thieving machine by Google Research in [[w:NeurIPS|w:NeurIPS]] 2018.}}
As of 2020 the digital sing-alikes may not yet be here, but when we hear a faked singing voice and we cannot hear that it is fake, then we will know. An ability to sing does not seem to add much hostile capabilities compared to the ability to thieve spoken word.
As of 2020 the digital sing-alikes may not yet be here, but when we hear a faked singing voice and we cannot hear that it is fake, then we will know. An ability to sing does not seem to add much hostile capabilities compared to the ability to thieve spoken word.


Line 181: Line 199:
=== Temporal limit of digital sound-alikes ===
=== Temporal limit of digital sound-alikes ===
[[File:Edison_and_phonograph_edit1.jpg|thumb|left|210px|[[w:Thomas Edison]] and his early [[w:phonograph]]. Cropped from [[w:Library of Congress]] copy, ca. 1877,  (probably 18 April 1878)]]
[[File:Edison_and_phonograph_edit1.jpg|thumb|left|210px|[[w:Thomas Edison]] and his early [[w:phonograph]]. Cropped from [[w:Library of Congress]] copy, ca. 1877,  (probably 18 April 1878)]]
The temporal limit of whom, dead or living, the digital sound-alikes can attack is defined by the '''[[w:history of sound recording]]'''. The article starts by mentioning that the invention of the [[w:phonograph]] by [[w:Thomas Edison]] in '''1877''' is considered the start of sound recording, though it does mention Scott's '''phonautograph''' of '''1857''' in bold font.
----


The below video 'This AI Clones Your Voice After Listening for 5 Seconds' by '2 minute papers' describes the voice thieving machine presented by Google Research in [[w:NeurIPS|w:NeurIPS]] 2018.
The temporal limit of whom, dead or living, the digital sound-alikes can attack is defined by the '''[[w:history of sound recording]]'''.
 
{{#ev:youtube|0sR1rU3gLzQ|640px|right|Video 'This AI Clones Your Voice After Listening for 5 Seconds' by '2 minute papers' describes the voice thieving machine by Google Research in [[w:NeurIPS|w:NeurIPS]] 2018.}}
The article starts by mentioning that the invention of the [[w:phonograph]] by [[w:Thomas Edison]] in '''1877''' is considered the start of sound recording.
 
The '''phonautograph''' is the earliest known device for recording [[w:sound]]. Previously, tracings had been obtained of the sound-producing vibratory motions of [[w:tuning forks]] and other objects by physical contact with them, but not of actual sound waves as they propagated through air or other media. Invented by Frenchman [[W:Édouard-Léon Scott de Martinville]], it was patented on March 25, '''1857'''.<ref name="NPR-Phonautograph">
 
{{Cite news
|url=https://www.npr.org/templates/story/story.php?storyId=89380697
|title=1860 'Phonautograph' Is Earliest Known Recording
|last=Flatow
|first=Ira|date=April 4, 2008|work=NPR
|access-date=2012-12-09
|language=en}}
 
</ref>
 
Apparently, it did not occur to anyone before the 1870s that the recordings, called '''phonautograms''', contained enough information about the sound that they could, in theory, be '''used to recreate it'''. Because the phonautogram tracing was an insubstantial two-dimensional line, direct physical playback was impossible in any case. Several phonautograms recorded '''before 1861''' were successfully played as sound in '''2008''' by optically scanning them and using a computer to process the scans into digital audio files. ([[w:Phonautograph|Wikipedia]])


[[File:Spectrogram-19thC.png|thumb|right|640px|A [[w:spectrogram]] of a male voice saying 'nineteenth century']]
[[File:Spectrogram-19thC.png|thumb|right|640px|A [[w:spectrogram]] of a male voice saying 'nineteenth century']]
Line 223: Line 253:
* '''[[w:University of Colorado Denver]]''' is the home of the [https://artsandmedia.ucdenver.edu/areas-of-study/national-center-for-media-forensics/about-the-national-center-for-media-forensics '''National Center for Media Forensics''' at artsandmedia.ucdenver.edu] at the [[w:University of Colorado Denver]] offers a [https://artsandmedia.ucdenver.edu/areas-of-study/national-center-for-media-forensics/media-forensics-graduate-program Master's degree program], [https://artsandmedia.ucdenver.edu/areas-of-study/national-center-for-media-forensics/training-courses training courses] and [https://artsandmedia.ucdenver.edu/areas-of-study/national-center-for-media-forensics/national-center-for-media-forensics-research scientific basic and applied research]. [https://artsandmedia.ucdenver.edu/areas-of-study/national-center-for-media-forensics/faculty-staff Faculty staff at the NCMF]
* '''[[w:University of Colorado Denver]]''' is the home of the [https://artsandmedia.ucdenver.edu/areas-of-study/national-center-for-media-forensics/about-the-national-center-for-media-forensics '''National Center for Media Forensics''' at artsandmedia.ucdenver.edu] at the [[w:University of Colorado Denver]] offers a [https://artsandmedia.ucdenver.edu/areas-of-study/national-center-for-media-forensics/media-forensics-graduate-program Master's degree program], [https://artsandmedia.ucdenver.edu/areas-of-study/national-center-for-media-forensics/training-courses training courses] and [https://artsandmedia.ucdenver.edu/areas-of-study/national-center-for-media-forensics/national-center-for-media-forensics-research scientific basic and applied research]. [https://artsandmedia.ucdenver.edu/areas-of-study/national-center-for-media-forensics/faculty-staff Faculty staff at the NCMF]


[[File:Connie Leyva 2015.jpg|thumb|left|240px|[[w:California]] [[w:California State Senate|w:Senator]] [[w:Connie Leyva]] introduced [https://leginfo.legislature.ca.gov/faces/billNavClient.xhtml?bill_id=201920200SB564 California Senate Bill SB 564] in Feb '''2019'''. It has been [https://www.sagaftra.org/action-alert-support-california-bill-end-deepfake-porn endorsed by SAG-AFTRA], but has not yet passed.]]
[[File:Connie Leyva 2015.jpg|thumb|left|240px|[[w:California]] [[w:California State Senate|w:Senator]] [[w:Connie Leyva]] sponsored [https://leginfo.legislature.ca.gov/faces/billCompareClient.xhtml?bill_id=201920200SB564&showamends=false '''California Senate Bill SB 564''' - ''Depiction of individual using digital or electronic technology: sexually explicit material: cause of action''] in Feb '''2019'''. It is identical to Assembly Bill 602 authored by [[w:Marc Berman]]. The bill was [https://www.sagaftra.org/action-alert-support-california-bill-end-deepfake-porn endorsed by SAG-AFTRA]. It became law on 1 January 2020 in the [[w:California Civil Code|w:California Civil Code]] of the [[w:California Codes]].]]


* '''[[w:SAG-AFTRA]]''' [https://www.sagaftra.org/action-alert-support-california-bill-end-deepfake-porn SAG-AFTRA ACTION ALERT: '''"Support California Bill to End Deepfake Porn"''' at sagaftra.org '''endorses'''] [https://leginfo.legislature.ca.gov/faces/billNavClient.xhtml?bill_id=201920200SB564 California Senate Bill SB 564] introduced to the  [[w:California State Senate]] by [[w:California]] [[w:Connie Leyva|w:Senator Connie Leyva]] in Feb '''2019'''.
* '''[[w:SAG-AFTRA]]''' [https://www.sagaftra.org/action-alert-support-california-bill-end-deepfake-porn SAG-AFTRA ACTION ALERT: '''"Support California Bill to End Deepfake Porn"''' at sagaftra.org '''endorses'''] [https://leginfo.legislature.ca.gov/faces/billNavClient.xhtml?bill_id=201920200SB564 California Senate Bill SB 564] introduced to the  [[w:California State Senate]] by [[w:California]] [[w:Connie Leyva|w:Senator Connie Leyva]] in Feb '''2019'''.
=== Organizations possibly against synthetic human-like fakes ===
Originally harvested from the study [https://www.europarl.europa.eu/RegData/etudes/STUD/2020/634452/EPRS_STU(2020)634452_EN.pdf The ethics of artificial intelligence: Issues and initiatives (.pdf)]  by the [[w:European Parliamentary Research Service]], published on the [[w:Europa (web portal)]] in March 2020.<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020">
{{cite web
|url= https://www.europarl.europa.eu/RegData/etudes/STUD/2020/634452/EPRS_STU(2020)634452_EN.pdf
|title= The ethics of artificial intelligence: Issues and initiatives
|last=
|first=
|date= March 2020
|website= [[w:Europa (web portal)]]
|publisher=[[w:European Parliamentary Research Service]]
|access-date=2021-02-17
|quote=This study deals with the ethical implications and moral questions that arise from the development and implementation of artificial intelligence (AI) technologies.}}
</ref>
* [https://ieai.mcts.tum.de/ '''INSTITUTE FOR ETHICS IN ARTIFICIAL INTELLIGENCE''' at ieai.mcts.tum.de] received initial funding from [[w:Facebook]] in 2019.<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> [https://www.linkedin.com/company/ieaitum/ IEAI on LinkedIn.com]
* [https://ethical.institute/ '''The Institute for Ethical AI & Machine Learning''' at ethical.institute]<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> [https://www.linkedin.com/company/the-institute-for-ethical-machine-learning/ The Institute for Ethical AI & Machine Learning on LinkedIn.com]
* [https://www.buckingham.ac.uk/research-the-institute-for-ethical-ai-in-education/ '''The Institute for Ethical AI in Education''' at buckingham.ac.uk]<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/>
* [https://futureoflife.org/ '''Future of Life Institute''' at futureoflife.org] received funding from private donors.<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> See [[w:Future of Life Institute]] for more info.
* [https://www.ai-gakkai.or.jp/ '''The Japanese Society for Artificial Intelligence''' ('''JSAI''') at ai-gakkai.or.jp]. Publication: Ethical guidelines.<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/>
* [https://ai-4-all.org/ '''AI4All''' at ai-4-all.org] funded by [[w:Google]]<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> [https://www.linkedin.com/company/ai4allorg/ AI4All on LinkedIn.com]
* [https://thefuturesociety.org/ '''The Future Society''' at thefuturesociety.org]<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> [https://www.linkedin.com/company/thefuturesociety/ The Future Society on LinkedIn.com]
* [https://ainowinstitute.org/ '''The Ai Now Institute''' at ainowinstitute.org] at [[w:New York University]]<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> [https://www.linkedin.com/company/ai-now-institute/about/ The Ai Now Institute on LinkedIn.com]
* [https://www.partnershiponai.org/ '''Partnership on AI''' at partnershiponai.org] is based in the USA and funded by technology companies. See [[w:Partnership on AI]] and [https://www.linkedin.com/company/partnershipai/ Partnership on AI on LinkedIn.com] for more info.
* [https://responsiblerobotics.org/ '''The Foundation for Responsible Robotics''' at responsiblerobotics.org] is based in [[w:Netherlands]].<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> [https://www.linkedin.com/company/foundation-for-responsible-robotics/about/ The Foundation for Responsible Robotics on LinkedIn.com]
* [https://ai4people.eu/ '''AI4People''' at ai4people.eu] is based in [[w:Belgium]] is a multi-stakeholder forum.<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> [https://www.linkedin.com/company/ai-for-people/ AI4People on LinkedIn.com]
* [https://aiethicsinitiative.org/ '''The Ethics and Governance of Artificial Intelligence Initiative''' at aiethicsinitiative.org] is based in the USA.<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/>
* [https://www.saidot.ai/ '''Saidot''' at saidot.ai] is a Finnish company offering a platform for AI transparency, explainability and communication.<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> [https://www.linkedin.com/company/saidot/ Saidot on LinkedIn.com]
* [https://www.eu-robotics.net/ '''euRobotics''' at eu-robotics.net] is funded by the [[w:European Commission]].<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/>
* [https://www.gov.uk/government/organisations/centre-for-data-ethics-and-innovation '''Centre for Data Ethics and Innovation''' at gov.uk] financed by the UK govt. [https://cdei.blog.gov.uk/ '''Centre for Data Ethics and Innovation Blog''' at cdei.blog.gov.uk]<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> [https://www.linkedin.com/company/centre-for-data-ethics-innovation/ Centre for Data Ethics and Innovation on LinkedIn.com]
* [http://sigai.acm.org/ '''ACM Special Interest Group on Artificial Intelligence''' at sigai.acm.org] is a [[w:Special Interest Group]] on AI by [[w:Association for Computing Machinery|ACM]].<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/>
* [https://ethicsinaction.ieee.org/ '''IEEE Ethics in Action - in Autonomous and Intelligent Systems''' at ethicsinaction.ieee.org]
=== Other essential developments ===
* [https://www.montrealdeclaration-responsibleai.com/ '''The Montréal Declaration for a Responsible Development of Artificial Intelligence''' at montrealdeclaration-responsibleai.com] and the same site in French [https://www.declarationmontreal-iaresponsable.com/ '''La Déclaration de Montéal IA responsable''' at declarationmontreal-iaresponsable.com]<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/>
* [https://uniglobalunion.org/ '''UNI Global Union''' at uniglobalunion.org] is based in [[w:Nyon]], [[w:Switzerland]] and deals mainly with labor issues to do with AI and robotics.<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> [https://www.linkedin.com/company/uni-global-union/ UNI Global Union on LinkedIn.com]
* [https://cordis.europa.eu/project/id/IST-2000-26048 '''European Robotics Research Network''' at cordis.europa.eu] funded by the [[w:European Commission]].<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/>
* [https://www.eu-robotics.net/ '''European Robotics Platform''' at eu-robotics.net] is funded by the [[w:European Commission]]. See [[w:European Robotics Platform]] and [[w:List of European Union robotics projects#EUROP]] for more info.<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/>


=== Events against synthetic human-like fakes ===
=== Events against synthetic human-like fakes ===
Line 249: Line 336:
=== Studies against synthetic human-like fakes ===
=== Studies against synthetic human-like fakes ===


* [https://arxiv.org/abs/2001.06564 ''''Media Forensics and DeepFakes: an overview'''' at arXiv.org] [https://arxiv.org/pdf/2001.06564.pdf (as .pdf at arXiv.org)], a '''2020''' '''review''' on the subject of digital look-alikes and media forensics
* [https://arxiv.org/abs/2001.06564 ''''Media Forensics and DeepFakes: an overview'''' at arXiv.org] [https://arxiv.org/pdf/2001.06564.pdf (as .pdf at arXiv.org)], an overview on the subject of digital look-alikes and media forensics published in August '''2020''' in [https://ieeexplore.ieee.org/xpl/tocresult.jsp?isnumber=9177372 Volume 14 Issue 5 of IEEE Journal of Selected Topics in Signal Processing]. [https://ieeexplore.ieee.org/document/9115874 ''''Media Forensics and DeepFakes: An Overview'''' at ieeexplore.ieee.org] (paywalled, free abstract)


* [https://scholarship.law.duke.edu/cgi/viewcontent.cgi?article=1333&context=dltr ''''DEEPFAKES: False pornography is here and the law cannot protect you'''' at scholarship.law.duke.edu] by Douglas Harris, published in [https://scholarship.law.duke.edu/dltr/vol17/iss1/ Duke Law & Technology Review - Volume 17 on '''2019'''-01-05] by [[w:Duke University]] [[w:Duke University School of Law]]
* [https://scholarship.law.duke.edu/cgi/viewcontent.cgi?article=1333&context=dltr ''''DEEPFAKES: False pornography is here and the law cannot protect you'''' at scholarship.law.duke.edu] by Douglas Harris, published in [https://scholarship.law.duke.edu/dltr/vol17/iss1/ Duke Law & Technology Review - Volume 17 on '''2019'''-01-05] by [[w:Duke University]] [[w:Duke University School of Law]]
Line 263: Line 350:
<section end=APW_AI-transclusion />
<section end=APW_AI-transclusion />


=== SSF! wiki proposed countermeasure to synthetic porn: Adequate Porn Watcher AI (transcluded) ===
=== SSF! wiki proposed countermeasure to weaponized synthetic pornography: Outlaw unauthorized synthetic pornography (transcluded) ===
Transcluded main contents from [[Adequate Porn Watcher AI]]
Transcluded from [[Current and possible laws and their application#Law proposal to ban visual synthetic filth|Juho's proposal for banning unauthorized synthetic pornography]]


{{#lstx:Adequate Porn Watcher AI|See_also}}
{{#section-h:Current and possible laws and their application|Law proposal to ban visual synthetic filth}}


=== Possible legal response: Outlawing digital sound-alikes (transcluded) ===
=== SSF! wiki proposed countermeasure to weaponized synthetic porn pornography: Adequate Porn Watcher AI (concept) (transcluded) ===
Transcluded from [[Law proposals#Law proposal to ban covert modeling of human voice|Juho's proposal on banning digital sound-alikes]]
Transcluded main contents from [[Adequate Porn Watcher AI (concept)]]


{{#section-h:Law proposals|Law proposal to ban covert modeling of human voice}}
{{#lstx:Adequate Porn Watcher AI (concept)|See_also}}
 
=== SSF! wiki proposed countermeasure to digital sound-alikes: Outlawing digital sound-alikes (transcluded) ===
Transcluded from [[Current and possible laws and their application#Law proposal to ban unauthorized modeling of human voice|Juho's proposal on banning digital sound-alikes]]
 
{{#section-h:Current and possible laws and their application|Law proposal to ban unauthorized modeling of human voice}}


== Timeline  of synthetic human-like fakes ==
== Timeline  of synthetic human-like fakes ==
Line 285: Line 377:
** [https://www.cnet.com/news/mit-releases-deepfake-video-of-nixon-announcing-nasa-apollo-11-disaster/ Cnet.com July 2020 reporting ''MIT releases deepfake video of 'Nixon' announcing NASA Apollo 11 disaster'']
** [https://www.cnet.com/news/mit-releases-deepfake-video-of-nixon-announcing-nasa-apollo-11-disaster/ Cnet.com July 2020 reporting ''MIT releases deepfake video of 'Nixon' announcing NASA Apollo 11 disaster'']


[[File:Marc Berman.jpg|thumb|120px|left|Homie [[w:Marc Berman|w:Marc Berman]], a righteous fighter for our human rights in this age of industrial disinformation filth and a member of the [[w:California State Assembly]], most loved for authoring [https://leginfo.legislature.ca.gov/faces/billTextClient.xhtml?bill_id=201920200AB602 AB-602], which came into effect on Jan 1 2020, banning both the manufacturing and [[w:digital distribution]] of synthetic pornography without the [[w:consent]] of the people depicted.]]
* '''2020''' | US state law | {{#lst:Current and possible laws and their application|California2020}}
 
* '''2020''' | Chinese legislation | {{#lst:Current and possible laws and their application|China2020}}
* '''2020''' | US state law | January 1 <ref name="KFI2019">
 
{{cite web
|url= https://kfiam640.iheart.com/content/2019-12-30-here-are-the-new-california-laws-going-into-effect-in-2020/
|title= Here Are the New California Laws Going Into Effect in 2020
|last= Johnson
|first= R.J.
|date= 2019-12-30
|website= [[KFI]]
|publisher= [[iHeartMedia]]
|access-date= 2020-07-13
|quote=}}
 
</ref> the [[w:California]] [[w:State law (United States)|w:US state law]] [https://leginfo.legislature.ca.gov/faces/billTextClient.xhtml?bill_id=201920200AB602 AB-602] came into effect banning the manufacturing and [[w:digital distribution]] of synthetic pornography without the [[w:consent]] of the people depicted.  AB-602 provides victims of synthetic pornography with [[w:injunction|w:injunctive relief]] and poses legal threats of [[w:statutory damages|w:statutory]] and [[w:punitive damages]] on [[w:criminal]]s making or distributing synthetic pornography without consent. The bill AB-602 was signed into law by California [[w:Governor (United States)|w:Governor]] [[w:Gavin Newsom]] on October 3 2019 and was authored by [[w:California State Assembly]] member [[w:Marc Berman]].<ref name="CNET2019">
 
{{cite web
| last = Mihalcik
| first = Carrie
| title = California laws seek to crack down on deepfakes in politics and porn
| website = [[w:cnet.com]]
| publisher = [[w:CNET]]
| date = 2019-10-04
| url = https://www.cnet.com/news/california-laws-seek-to-crack-down-on-deepfakes-in-politics-and-porn/
| access-date = 2020-07-13
}}
 
</ref>
* '''2020''' | Chinese legislation | On January 1 Chinese law requiring that synthetically faked footage should bear a clear notice about its fakeness came into effect. Failure to comply could be considered a [[w:crime]] the [[w:Cyberspace Administration of China]] stated on its website. China announced this new law in November 2019.<ref name="Reuters2019">
 
{{cite web
| url = https://www.reuters.com/article/us-china-technology/china-seeks-to-root-out-fake-news-and-deepfakes-with-new-online-content-rules-idUSKBN1Y30VU
| title = China seeks to root out fake news and deepfakes with new online content rules
| last =
| first =
| date = 2019-11-29
| website = [[w:Reuters.com]]
| publisher = [[w:Reuters]]
| access-date = 2020-07-13
| quote = }}
 
</ref> The Chinese government seems to be reserving the right to prosecute both users and [[w:online video platform]]s failing to abide by the rules. <ref name="TheVerge2019">
 
{{cite web
| url = https://www.theverge.com/2019/11/29/20988363/china-deepfakes-ban-internet-rules-fake-news-disclosure-virtual-reality
| title = China makes it a criminal offense to publish deepfakes or fake news without disclosure
| last = Statt
| first = Nick
| date = 2019-11-29
| website =
| publisher = [[w:The Verge]]
| access-date = 2020-07-13
| quote = }}
 
</ref>


=== 2010's synthetic human-like fakes ===
=== 2010's synthetic human-like fakes ===
Line 346: Line 384:
* '''2019''' | demonstration | In September 2019 [[w:Yle]], the Finnish [[w:public broadcasting company]], aired a result of experimental [[w:journalism]], [https://yle.fi/uutiset/3-10955498 '''a deepfake of the President in office'''] [[w:Sauli Niinistö]] in its main news broadcast for the purpose of highlighting the advancing disinformation technology and problems that arise from it.
* '''2019''' | demonstration | In September 2019 [[w:Yle]], the Finnish [[w:public broadcasting company]], aired a result of experimental [[w:journalism]], [https://yle.fi/uutiset/3-10955498 '''a deepfake of the President in office'''] [[w:Sauli Niinistö]] in its main news broadcast for the purpose of highlighting the advancing disinformation technology and problems that arise from it.


* '''2019''' | US state law | Since September 1 [[w:Texas]] senate bill [https://capitol.texas.gov/tlodocs/86R/billtext/html/SB00751F.htm '''SB 751'''] [[w:amendment]]s to the election code came into effect, giving [[w:candidates]] in [[w:elections]] a 30-day protection period to the elections during which making and distributing digital look-alikes or synthetic fakes of the candidates is an offense. The law text defines the subject of the law as "''a  video, created with the intent to deceive, that appears to depict a real person performing an action that did not occur in reality''"<ref name="TexasSB751">
* '''2019''' | US state law | {{#lst:Current and possible laws and their application|Texas2019}}


{{cite web
* '''2019''' | US state law | {{#lst:Current and possible laws and their application|Virginia2019}}
|url= https://capitol.texas.gov/BillLookup/History.aspx?LegSess=86R&Bill=SB751
|title= Relating to the creation of a criminal offense for fabricating a deceptive video with intent to influence the outcome of an election
|last=
|first=
|date= 2019-06-14
|website=
|publisher= [[w:Texas]]
|access-date= 2020-07-13
|quote= In  this  section,  "deep  fake  video"  means  a  video, created with the intent to deceive, that appears to depict a real person performing an action that did not occur in reality}}
 
</ref>
 
[[File:Marcus Simon.jpeg|thumb|right|108px|Homie [[w:Marcus Simon|w:Marcus Simon]] ([http://marcussimon.com/ marcussimon.com]) is a Member of the [[w:Virginia House of Delegates]] and a true pioneer in legislating against synthetic filth.]]
 
* '''2019''' | US state law | Since July 1  <ref>
 
{{Cite web
| url=https://www.fauquier.com/news/new-state-laws-go-into-effect-july/article_6e2e16c8-96b7-11e9-88d0-83a8852ef3eb.html
| title=New state laws go into effect July 1
}}
 
</ref> [[w:Virginia]] [[w:criminalization|w:has criminalized]] the sale and dissemination of unauthorized synthetic pornography, but not the manufacture.<ref name="Virginia2019Chapter515">
{{cite web
| url = https://law.lis.virginia.gov/vacode/18.2-386.2/
| title = § 18.2-386.2. Unlawful dissemination or sale of images of another; penalty.
| last =
| first =
| date =
| website =
| publisher = [[w:Virginia]]
| access-date = 2020-07-13
| quote = }}
 
</ref>, as [https://law.lis.virginia.gov/vacode/18.2-386.2/ § 18.2-386.2 titled ''''''Unlawful dissemination or sale of images of another; penalty.''''''] became part of the '''[[w:Code of Virginia]]'''. The law text states: "''Any person who, with the [[w:Intention (criminal law)|w:intent]] to [[w:coercion|w:coerce]], [[w:harassment|w:harass]], or [[w:intimidation|w:intimidate]], [[w:Malice_(law)|w:malicious]]ly [[w:dissemination|w:disseminates]] or [[w:sales|w:sells]] any videographic or still image created by any means whatsoever that depicts another person who is totally [w:[nudity|nude]], or in a state of undress so as to expose the [[w:sex organs|w:genitals]], pubic area, [[w:buttocks]], or female [[w:breast]], where such person knows or has reason to know that he is not [[w:license]]d or [[w:authorization|w:authorized]] to disseminate or sell such videographic or still image is guilty of a Class 1 [[w:Misdemeanor#United States|w:misdemeanor]].''".<ref name="Virginia2019Chapter515"/> The identical bills were [https://lis.virginia.gov/cgi-bin/legp604.exe?191+sum+HB2678 House Bill 2678] presented by [[w:Delegate (American politics)|w:Delegate]] [[w:Marcus Simon]] to the [[w:Virginia House of Delegates]] on January 14 2019 and three day later an identical [https://lis.virginia.gov/cgi-bin/legp604.exe?191+sum+SB1736 Senate bill 1736] was introduced to the [[w:Senate of Virginia]] by Senator [[w:Adam Ebbin]].


* '''2019''' | science and demonstration | [https://arxiv.org/pdf/1905.09773.pdf ''''Speech2Face: Learning the Face Behind a Voice'''' at arXiv.org] a system for generating likely facial features based on the voice of a person, presented by the [[w:MIT Computer Science and Artificial Intelligence Laboratory]] at the 2019 [[w:Conference on Computer Vision and Pattern Recognition|w:CVPR]]. [https://github.com/saiteja-talluri/Speech2Face Speech2Face at github.com] This may develop to something that really causes problems. [https://neurohive.io/en/news/speech2face-neural-network-predicts-the-face-behind-a-voice/ "Speech2Face: Neural Network Predicts the Face Behind a Voice" reporing at neurohive.io], [https://belitsoft.com/speech-recognition-software-development/speech2face "Speech2Face Sees Voices and Hears Faces: Dreams Come True with AI" reporting at belitsoft.com]
* '''2019''' | science and demonstration | [https://arxiv.org/pdf/1905.09773.pdf ''''Speech2Face: Learning the Face Behind a Voice'''' at arXiv.org] a system for generating likely facial features based on the voice of a person, presented by the [[w:MIT Computer Science and Artificial Intelligence Laboratory]] at the 2019 [[w:Conference on Computer Vision and Pattern Recognition|w:CVPR]]. [https://github.com/saiteja-talluri/Speech2Face Speech2Face at github.com] This may develop to something that really causes problems. [https://neurohive.io/en/news/speech2face-neural-network-predicts-the-face-behind-a-voice/ "Speech2Face: Neural Network Predicts the Face Behind a Voice" reporing at neurohive.io], [https://belitsoft.com/speech-recognition-software-development/speech2face "Speech2Face Sees Voices and Hears Faces: Dreams Come True with AI" reporting at belitsoft.com]
Line 582: Line 586:


----
----
== Media perhaps about synthetic human-like fakes ==
This is a chronological listing of media that are probably to do with [[synthetic human-like fakes]].
The links currently include scripture, science, demonstrations, music videos, music, entertainment and movies.
=== 2020's media perhaps about synthetic human-like fakes ===
* '''2022''' | movie | '''''[[w:The Matrix 4]]''''' ('''2022''') will be the 4th installment of the [[w:The Matrix (franchise)]]. Relevancy: High likelihood of relevance, but unknown as this film is not yet ready or released.
=== 2010's media perhaps about synthetic human-like fakes  ===
* '''2018''' | music video | [https://www.youtube.com/watch?v=X8f5RgwY8CI&list=PLxKHVMqMZqUTgHYRSXfZN_JjItBzVTCau ''''''Simulation Theory'''''' album by '''Muse''' on Youtube] by [[w:Muse (band)]] from the [[w:Simulation Theory (album)]]. '''Obs.''' "The Pause," "Watch What I Do" and "The Interlude" are not part of the album. Relevancy: Whole album
* '''2016''' | music video |[https://www.youtube.com/watch?v=ElvLZMsYXlo ''''''Voodoo In My Blood'''''' (official music video) by '''Massive Attack''' on Youtube] by [[w:Massive Attack]] and featuring [[w:Tricky]] from the album [[w:Ritual Spirit]]. Relevancy: '''How many machines''' can you see in the same frame at times? If you answered one, look harder and make a more educated guess.
* '''2016''' | music video | [https://www.youtube.com/watch?v=8r31DFrFs5A ''''''The Spoils'''''' by '''Massive Attack''' on Youtube] by [[w:Massive Attack]] featuring [[w:Hope Sandoval]]. [[w:The Spoils (song)|Wikipedia on The Spoils (song)]] Relevancy: The video '''contains synthesis''' of '''human-like''' likenesses.
* '''2013''' | music | [https://www.youtube.com/watch?v=VvT8ydMiETc ''''''In Two'''''' by the '''Nine Inch Nails''' (lyric video) on Youtube] by [[w:Nine Inch Nails]] from the album [[w:Hesitation Marks]]. Relevancy: The '''lyrics''' seem to be about '''appearance theft'''.
* '''2013''' | music | [https://www.youtube.com/watch?v=Rn3W6ok-IhE ''''''Copy of A'''''' by the '''Nine Inch Nails''' (lyric video) on Youtube] by [[w:Nine Inch Nails]] from the album [[w:Hesitation Marks]]. Relevancy: The '''lyrics''' seem to be about '''appearance theft'''.
* '''2013''' | music video | [https://www.youtube.com/watch?v=ZWrUEsVrdSU ''''''Before Your Very Eyes'''''' by '''Atoms For Peace''' (official music video) on Youtube] by [[w:Atoms for Peace (band)]] from their album [[w:Amok (Atoms for Peace album)]]. Video was made by [http://www.andrewthomashuang.com/ Andrew Thomas Huang (.com)] Relevancy: Watch the video
=== 2000's media perhaps about synthetic human-like fakes  ===
* '''2006''' | music video | [https://www.youtube.com/watch?v=hC_sqi9oocI ''''''John The Revelator'''''' by '''Depeche Mode''' (official music video) on Youtube] by [[w:Depeche Mode]] from the single [[w:John the Revelator / Lilian]]. Relevancy: [[Biblical explanation - The books of Daniel and Revelation#Revelation 13|Book of Revelations]].
* '''2005''' | music video | [https://www.youtube.com/watch?v=wwvLlEtxX3o ''''''Only'''''' by Nine '''Inch Nails''' at Youtube.com] [[w:Only (Nine Inch Nails song)]] by the [[w:Nine Inch Nails]]. Relevancy: check the lyrics, check the video
* '''2005''' | short film | [https://www.youtube.com/watch?v=zl6hNj1uOkY ''''''Doll Face'''''' by '''Andy Huang''' on youtube.com] was uploaded on 2007-02-19 by [http://www.andrewthomashuang.com/ Andrew Thomas Huang (.com)]. There are various unofficial videos using 'Doll Face' as graphics, but with different music.
* '''2001''' | music video | [https://www.youtube.com/watch?v=dbB-mICjkQM ''''''Plug In Baby'''''' by '''Muse''' on youtube.com] by [[w:Muse (band)]] from their album [[w:Origin of Symmetry]]. Relevancy: See video
* '''2001''' | music video | [https://www.youtube.com/watch?v=lWIeVTs94rI ''''''Evolution Revolution Love'''''' by '''Tricky''' on Youtube] by [[w:Tricky (musician)]] from the [[w:Blowback (album)]] and featuring [[w:Ed Kowalczyk]]. Relevancy: See video
=== 1990's media perhaps about synthetic human-like fakes  ===
* '''1998''' | music video | [https://www.youtube.com/watch?v=XbByxzZ-4dI ''''''Rabbit in Your Headlights'''''' by '''UNKLE''' on Youtube] by [[w:Unkle]] and featuring [[w:Thom Yorke]] on the lyrics.  [[w:Rabbit in Your Headlights#Music video|Wikipedia on 'Rabbit in Your Headlights' music video]]. Relevancy: Contains shots that would have '''injured''' / '''killed''' a '''human actor'''.
* '''1998''' | music | [https://www.youtube.com/watch?v=sjrnKG1j3Eg ''''''New Model No. 15'''''' by '''Marilyn Manson''' (lyrics in video) on Youtube] by [[w:Marilyn Manson (band)]] from the album [[w:Mechanical Animals]]. Relevancy: The '''lyrics''' are obviously about '''[[digital look-alikes]]''' approaching.
* '''1998''' |  music video | [https://www.youtube.com/watch?v=FC-Kos_b1sE ''''''The Dope Show'''''' by '''Marilyn Manson''' (lyric video) on Youtube] [https://www.youtube.com/watch?v=5R682M3ZEyk (official music video)] by [[w:Marilyn Manson (band)]] from the album [[w:Mechanical Animals]]. Relevancy: '''lyrics'''
* '''1996''' | music | [https://www.youtube.com/watch?v=LMK9z5jyKbQ ''''''Dead Cities'''''' by '''The Future Sound of London''' on Youtube] - Title track from the 1996 [[w:The Future Sound of London]] album [[w:Dead Cities (album)]]. Relevancy: You need to listen
* '''1990''' | music (video) | [https://www.youtube.com/watch?v=JG9CXQxhfL4 ''''''Daydreaming'''''' by '''Massive Attack''' on youtube.com] [[w:Daydreaming (Massive Attack song)]] by [[w:Massive Attack]] Relevancy: "''But what happen when the bomb drops Down...?''"
=== 1980's media perhaps about synthetic human-like fakes ===
* '''1986''' | music video | [https://www.youtube.com/watch?v=6epzmRZk6UU ''''''Paranoimia'''''' by '''Art of Noise''' on Youtube]. [[w:Paranoimia]] by [[w:Art of Noise]] featuring Max Headroom from the album [[w:In Visible Silence]] Relevancy: Contains state-of-the-art (for the era) '''synthetic human-like character''', [[w:Max Headroom]]).
* '''1983''' | music video | [https://www.youtube.com/watch?v=O0lIlROWro8 ''''''Musique Non-Stop'''''' by '''Kraftwerk''' on Youtube] made in 1983, but published only in in '''1986''' by [[w:Kraftwerk]] from album [[w:Electric Café]]. Relevancy: Contains state-of-the-art (for the era) '''[[digital look-alikes]]''' of the band members.
=== 1st century media perhaps about synthetic human-like fakes  ===
* '''[[w:1st century]]''' | scripture | '''[[w:Jesus]] teaches''' about things that are yet to come in
*# '''[[w:Matthew 24]]'''
*# '''[[w:The Sheep and the Goats]]''' and
*# '''[[w:Mark 13]]'''.
*'''1st century''' | scripture | '''[[w:2 Thessalonians 2]]''' is the second chapter of the [[w:Second Epistle to the Thessalonians]]. It is traditionally attributed to [[w:Paul the Apostle]], with [[w:Saint Timothy]] as a co-author.  See [[Biblical explanation - The books of Daniel and Revelation#2 Thessalonians 2|Biblical explanation - The books of Daniel and Revelation § 2 Thessalonians 2]] '''Caution''' to reader: contains '''explicit''' written information about the beasts
*'''1st century''' | scripture | '''[[w:Book of Revelation]]'''. The task of writing down and smuggling out this early warning of what is to come is given by God to his servant John, who was imprisoned on the island of [[w:Patmos]].  See [[Biblical explanation - The books of Daniel and Revelation#Revelation 13|Biblical explanation - The books of Daniel and Revelation § Revelation 13]]. '''Caution''' to reader: contains '''explicit''' written information about the beasts.
=== 2nd century BC media perhaps about synthetic human-like fakes  ===
* [[w:2nd century BC]] | scripture | The '''[[w:Book of Daniel]]''' was put in writing.
* See [[Biblical explanation - The books of Daniel and Revelation#Daniel 7|Biblical explanation - The books of Daniel and Revelation § Daniel 7]]. '''Caution''' to reader: contains '''explicit''' written information about the beasts.
=== 6th century BC media perhaps about synthetic human-like fakes ===
[[File:Daniel's vision of the four beasts from the sea and the Ancient of Days - Silos Apocalypse (1109), f.240 - BL Add MS 11695.jpg|thumb|left|360px|Image taken from Silos Apocalypse. Originally published/produced in Spain (Silos), 1109.<br/><br/>
[[Biblical explanation - The books of Daniel and Revelation#Daniel 7|Daniel 7]], Daniel's vision of the three beasts <sup>[[Biblical explanation - The books of Daniel and Revelation#Daniel 7:1-6 - Three beasts|Dan 7:1-6]]</sup> and the fourth beast <sup>[[Biblical explanation - The books of Daniel and Revelation#Daniel 7:7-8 - The fourth beast|Dan 7:7-8]]</sup> from the sea and the [[w:Ancient of Days]]<sup>[[Biblical explanation - The books of Daniel and Revelation#The Ancient of Days|Dan 7:9-10]]</sup>]]
* [[w:6th century BC]] | scripture | '''[[w:Daniel (biblical figure)]]''' was in [[w:Babylonian captivity]] when he had his visions where God warned us of synthetic human-like fakes first.
* His testimony was put into written form in the [[#3rd century BC]].


== Footnotes ==
== Footnotes ==
We use only those cookies necessary for the functioning of the wiki and we will never sell your data. All data is stored in the EU.

Navigation menu