3,839
edits
Synthetic human-like fakes: Difference between revisions
Jump to navigation
Jump to search
→Countermeasures against synthetic human-like fakes: California Senate Bill SB 564 is the one that actually passed. AFAIK it was originally identical copy of the Assembly Bill 602 + linking the amended version
Juho Kunsola (talk | contribs) (→Timeline of synthetic human-like fakes: replace moved content with {{#lst:Current and possible laws and their application|Texas2019}}) |
Juho Kunsola (talk | contribs) (→Countermeasures against synthetic human-like fakes: California Senate Bill SB 564 is the one that actually passed. AFAIK it was originally identical copy of the Assembly Bill 602 + linking the amended version) |
||
| (31 intermediate revisions by the same user not shown) | |||
| Line 65: | Line 65: | ||
}}</ref> | }}</ref> | ||
{{ | {{#lst:Quotes|MatrixTrad}} | ||
=== The problems with digital look-alikes === | === The problems with digital look-alikes === | ||
| Line 146: | Line 146: | ||
=== 'Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis' 2018 by Google Research (external transclusion) === | === 'Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis' 2018 by Google Research (external transclusion) === | ||
<section begin=GoogleTransferLearning2018 /> | |||
* In the '''2018''' at the '''[[w:Conference on Neural Information Processing Systems]]''' (NeurIPS) the work [http://papers.nips.cc/paper/7700-transfer-learning-from-speaker-verification-to-multispeaker-text-to-speech-synthesis 'Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis'] ([https://arxiv.org/abs/1806.04558 at arXiv.org]) was presented. The pre-trained model is able to steal voices from a sample of only '''5 seconds''' with almost convincing results | * In the '''2018''' at the '''[[w:Conference on Neural Information Processing Systems]]''' (NeurIPS) the work [http://papers.nips.cc/paper/7700-transfer-learning-from-speaker-verification-to-multispeaker-text-to-speech-synthesis 'Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis'] ([https://arxiv.org/abs/1806.04558 at arXiv.org]) was presented. The pre-trained model is able to steal voices from a sample of only '''5 seconds''' with almost convincing results | ||
| Line 154: | Line 154: | ||
The Iframe above is transcluded from [https://google.github.io/tacotron/publications/speaker_adaptation/ 'Audio samples from "Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis"' at google.gituhub.io], the audio samples of a sound-like-anyone machine presented as at the 2018 [[w:NeurIPS]] conference by Google researchers. | The Iframe above is transcluded from [https://google.github.io/tacotron/publications/speaker_adaptation/ 'Audio samples from "Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis"' at google.gituhub.io], the audio samples of a sound-like-anyone machine presented as at the 2018 [[w:NeurIPS]] conference by Google researchers. | ||
<section end=GoogleTransferLearning2018 /> | |||
=== Digital sing-alikes === | === Digital sing-alikes === | ||
| Line 252: | Line 253: | ||
* '''[[w:University of Colorado Denver]]''' is the home of the [https://artsandmedia.ucdenver.edu/areas-of-study/national-center-for-media-forensics/about-the-national-center-for-media-forensics '''National Center for Media Forensics''' at artsandmedia.ucdenver.edu] at the [[w:University of Colorado Denver]] offers a [https://artsandmedia.ucdenver.edu/areas-of-study/national-center-for-media-forensics/media-forensics-graduate-program Master's degree program], [https://artsandmedia.ucdenver.edu/areas-of-study/national-center-for-media-forensics/training-courses training courses] and [https://artsandmedia.ucdenver.edu/areas-of-study/national-center-for-media-forensics/national-center-for-media-forensics-research scientific basic and applied research]. [https://artsandmedia.ucdenver.edu/areas-of-study/national-center-for-media-forensics/faculty-staff Faculty staff at the NCMF] | * '''[[w:University of Colorado Denver]]''' is the home of the [https://artsandmedia.ucdenver.edu/areas-of-study/national-center-for-media-forensics/about-the-national-center-for-media-forensics '''National Center for Media Forensics''' at artsandmedia.ucdenver.edu] at the [[w:University of Colorado Denver]] offers a [https://artsandmedia.ucdenver.edu/areas-of-study/national-center-for-media-forensics/media-forensics-graduate-program Master's degree program], [https://artsandmedia.ucdenver.edu/areas-of-study/national-center-for-media-forensics/training-courses training courses] and [https://artsandmedia.ucdenver.edu/areas-of-study/national-center-for-media-forensics/national-center-for-media-forensics-research scientific basic and applied research]. [https://artsandmedia.ucdenver.edu/areas-of-study/national-center-for-media-forensics/faculty-staff Faculty staff at the NCMF] | ||
[[File:Connie Leyva 2015.jpg|thumb|left|240px|[[w:California]] [[w:California State Senate|w:Senator]] [[w:Connie Leyva]] | [[File:Connie Leyva 2015.jpg|thumb|left|240px|[[w:California]] [[w:California State Senate|w:Senator]] [[w:Connie Leyva]] sponsored [https://leginfo.legislature.ca.gov/faces/billCompareClient.xhtml?bill_id=201920200SB564&showamends=false '''California Senate Bill SB 564''' - ''Depiction of individual using digital or electronic technology: sexually explicit material: cause of action''] in Feb '''2019'''. It is identical to Assembly Bill 602 authored by [[w:Marc Berman]]. The bill was [https://www.sagaftra.org/action-alert-support-california-bill-end-deepfake-porn endorsed by SAG-AFTRA]. It became law on 1 January 2020 in the [[w:California Civil Code|w:California Civil Code]] of the [[w:California Codes]].]] | ||
* '''[[w:SAG-AFTRA]]''' [https://www.sagaftra.org/action-alert-support-california-bill-end-deepfake-porn SAG-AFTRA ACTION ALERT: '''"Support California Bill to End Deepfake Porn"''' at sagaftra.org '''endorses'''] [https://leginfo.legislature.ca.gov/faces/billNavClient.xhtml?bill_id=201920200SB564 California Senate Bill SB 564] introduced to the [[w:California State Senate]] by [[w:California]] [[w:Connie Leyva|w:Senator Connie Leyva]] in Feb '''2019'''. | * '''[[w:SAG-AFTRA]]''' [https://www.sagaftra.org/action-alert-support-california-bill-end-deepfake-porn SAG-AFTRA ACTION ALERT: '''"Support California Bill to End Deepfake Porn"''' at sagaftra.org '''endorses'''] [https://leginfo.legislature.ca.gov/faces/billNavClient.xhtml?bill_id=201920200SB564 California Senate Bill SB 564] introduced to the [[w:California State Senate]] by [[w:California]] [[w:Connie Leyva|w:Senator Connie Leyva]] in Feb '''2019'''. | ||
=== Organizations possibly against synthetic human-like fakes === | |||
Originally harvested from the study [https://www.europarl.europa.eu/RegData/etudes/STUD/2020/634452/EPRS_STU(2020)634452_EN.pdf The ethics of artificial intelligence: Issues and initiatives (.pdf)] by the [[w:European Parliamentary Research Service]], published on the [[w:Europa (web portal)]] in March 2020.<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"> | |||
{{cite web | |||
|url= https://www.europarl.europa.eu/RegData/etudes/STUD/2020/634452/EPRS_STU(2020)634452_EN.pdf | |||
|title= The ethics of artificial intelligence: Issues and initiatives | |||
|last= | |||
|first= | |||
|date= March 2020 | |||
|website= [[w:Europa (web portal)]] | |||
|publisher=[[w:European Parliamentary Research Service]] | |||
|access-date=2021-02-17 | |||
|quote=This study deals with the ethical implications and moral questions that arise from the development and implementation of artificial intelligence (AI) technologies.}} | |||
</ref> | |||
* [https://ieai.mcts.tum.de/ '''INSTITUTE FOR ETHICS IN ARTIFICIAL INTELLIGENCE''' at ieai.mcts.tum.de] received initial funding from [[w:Facebook]] in 2019.<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> [https://www.linkedin.com/company/ieaitum/ IEAI on LinkedIn.com] | |||
* [https://ethical.institute/ '''The Institute for Ethical AI & Machine Learning''' at ethical.institute]<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> [https://www.linkedin.com/company/the-institute-for-ethical-machine-learning/ The Institute for Ethical AI & Machine Learning on LinkedIn.com] | |||
* [https://www.buckingham.ac.uk/research-the-institute-for-ethical-ai-in-education/ '''The Institute for Ethical AI in Education''' at buckingham.ac.uk]<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> | |||
* [https://futureoflife.org/ '''Future of Life Institute''' at futureoflife.org] received funding from private donors.<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> See [[w:Future of Life Institute]] for more info. | |||
* [https://www.ai-gakkai.or.jp/ '''The Japanese Society for Artificial Intelligence''' ('''JSAI''') at ai-gakkai.or.jp]. Publication: Ethical guidelines.<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> | |||
* [https://ai-4-all.org/ '''AI4All''' at ai-4-all.org] funded by [[w:Google]]<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> [https://www.linkedin.com/company/ai4allorg/ AI4All on LinkedIn.com] | |||
* [https://thefuturesociety.org/ '''The Future Society''' at thefuturesociety.org]<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> [https://www.linkedin.com/company/thefuturesociety/ The Future Society on LinkedIn.com] | |||
* [https://ainowinstitute.org/ '''The Ai Now Institute''' at ainowinstitute.org] at [[w:New York University]]<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> [https://www.linkedin.com/company/ai-now-institute/about/ The Ai Now Institute on LinkedIn.com] | |||
* [https://www.partnershiponai.org/ '''Partnership on AI''' at partnershiponai.org] is based in the USA and funded by technology companies. See [[w:Partnership on AI]] and [https://www.linkedin.com/company/partnershipai/ Partnership on AI on LinkedIn.com] for more info. | |||
* [https://responsiblerobotics.org/ '''The Foundation for Responsible Robotics''' at responsiblerobotics.org] is based in [[w:Netherlands]].<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> [https://www.linkedin.com/company/foundation-for-responsible-robotics/about/ The Foundation for Responsible Robotics on LinkedIn.com] | |||
* [https://ai4people.eu/ '''AI4People''' at ai4people.eu] is based in [[w:Belgium]] is a multi-stakeholder forum.<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> [https://www.linkedin.com/company/ai-for-people/ AI4People on LinkedIn.com] | |||
* [https://aiethicsinitiative.org/ '''The Ethics and Governance of Artificial Intelligence Initiative''' at aiethicsinitiative.org] is based in the USA.<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> | |||
* [https://www.saidot.ai/ '''Saidot''' at saidot.ai] is a Finnish company offering a platform for AI transparency, explainability and communication.<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> [https://www.linkedin.com/company/saidot/ Saidot on LinkedIn.com] | |||
* [https://www.eu-robotics.net/ '''euRobotics''' at eu-robotics.net] is funded by the [[w:European Commission]].<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> | |||
* [https://www.gov.uk/government/organisations/centre-for-data-ethics-and-innovation '''Centre for Data Ethics and Innovation''' at gov.uk] financed by the UK govt. [https://cdei.blog.gov.uk/ '''Centre for Data Ethics and Innovation Blog''' at cdei.blog.gov.uk]<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> [https://www.linkedin.com/company/centre-for-data-ethics-innovation/ Centre for Data Ethics and Innovation on LinkedIn.com] | |||
* [http://sigai.acm.org/ '''ACM Special Interest Group on Artificial Intelligence''' at sigai.acm.org] is a [[w:Special Interest Group]] on AI by [[w:Association for Computing Machinery|ACM]].<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> | |||
* [https://ethicsinaction.ieee.org/ '''IEEE Ethics in Action - in Autonomous and Intelligent Systems''' at ethicsinaction.ieee.org] | |||
=== Other essential developments === | |||
* [https://www.montrealdeclaration-responsibleai.com/ '''The Montréal Declaration for a Responsible Development of Artificial Intelligence''' at montrealdeclaration-responsibleai.com] and the same site in French [https://www.declarationmontreal-iaresponsable.com/ '''La Déclaration de Montéal IA responsable''' at declarationmontreal-iaresponsable.com]<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> | |||
* [https://uniglobalunion.org/ '''UNI Global Union''' at uniglobalunion.org] is based in [[w:Nyon]], [[w:Switzerland]] and deals mainly with labor issues to do with AI and robotics.<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> [https://www.linkedin.com/company/uni-global-union/ UNI Global Union on LinkedIn.com] | |||
* [https://cordis.europa.eu/project/id/IST-2000-26048 '''European Robotics Research Network''' at cordis.europa.eu] funded by the [[w:European Commission]].<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> | |||
* [https://www.eu-robotics.net/ '''European Robotics Platform''' at eu-robotics.net] is funded by the [[w:European Commission]]. See [[w:European Robotics Platform]] and [[w:List of European Union robotics projects#EUROP]] for more info.<ref group="1st seen in" name="EU-Parl-Ethical-AI-Study-2020"/> | |||
=== Events against synthetic human-like fakes === | === Events against synthetic human-like fakes === | ||
| Line 278: | Line 336: | ||
=== Studies against synthetic human-like fakes === | === Studies against synthetic human-like fakes === | ||
* [https://arxiv.org/abs/2001.06564 ''''Media Forensics and DeepFakes: an overview'''' at arXiv.org] [https://arxiv.org/pdf/2001.06564.pdf (as .pdf at arXiv.org)], | * [https://arxiv.org/abs/2001.06564 ''''Media Forensics and DeepFakes: an overview'''' at arXiv.org] [https://arxiv.org/pdf/2001.06564.pdf (as .pdf at arXiv.org)], an overview on the subject of digital look-alikes and media forensics published in August '''2020''' in [https://ieeexplore.ieee.org/xpl/tocresult.jsp?isnumber=9177372 Volume 14 Issue 5 of IEEE Journal of Selected Topics in Signal Processing]. [https://ieeexplore.ieee.org/document/9115874 ''''Media Forensics and DeepFakes: An Overview'''' at ieeexplore.ieee.org] (paywalled, free abstract) | ||
* [https://scholarship.law.duke.edu/cgi/viewcontent.cgi?article=1333&context=dltr ''''DEEPFAKES: False pornography is here and the law cannot protect you'''' at scholarship.law.duke.edu] by Douglas Harris, published in [https://scholarship.law.duke.edu/dltr/vol17/iss1/ Duke Law & Technology Review - Volume 17 on '''2019'''-01-05] by [[w:Duke University]] [[w:Duke University School of Law]] | * [https://scholarship.law.duke.edu/cgi/viewcontent.cgi?article=1333&context=dltr ''''DEEPFAKES: False pornography is here and the law cannot protect you'''' at scholarship.law.duke.edu] by Douglas Harris, published in [https://scholarship.law.duke.edu/dltr/vol17/iss1/ Duke Law & Technology Review - Volume 17 on '''2019'''-01-05] by [[w:Duke University]] [[w:Duke University School of Law]] | ||
| Line 292: | Line 350: | ||
<section end=APW_AI-transclusion /> | <section end=APW_AI-transclusion /> | ||
=== SSF! wiki proposed countermeasure to synthetic porn: Adequate Porn Watcher AI (transcluded) === | === SSF! wiki proposed countermeasure to weaponized synthetic pornography: Outlaw unauthorized synthetic pornography (transcluded) === | ||
Transcluded from [[Current and possible laws and their application#Law proposal to ban visual synthetic filth|Juho's proposal for banning unauthorized synthetic pornography]] | |||
{{#section-h:Current and possible laws and their application|Law proposal to ban visual synthetic filth}} | |||
=== SSF! wiki proposed countermeasure to weaponized synthetic porn pornography: Adequate Porn Watcher AI (concept) (transcluded) === | |||
Transcluded main contents from [[Adequate Porn Watcher AI (concept)]] | Transcluded main contents from [[Adequate Porn Watcher AI (concept)]] | ||
{{#lstx:Adequate Porn Watcher AI (concept)|See_also}} | {{#lstx:Adequate Porn Watcher AI (concept)|See_also}} | ||
=== | === SSF! wiki proposed countermeasure to digital sound-alikes: Outlawing digital sound-alikes (transcluded) === | ||
Transcluded from [[ | Transcluded from [[Current and possible laws and their application#Law proposal to ban unauthorized modeling of human voice|Juho's proposal on banning digital sound-alikes]] | ||
{{#section-h: | {{#section-h:Current and possible laws and their application|Law proposal to ban unauthorized modeling of human voice}} | ||
== Timeline of synthetic human-like fakes == | == Timeline of synthetic human-like fakes == | ||
| Line 323: | Line 386: | ||
* '''2019''' | US state law | {{#lst:Current and possible laws and their application|Texas2019}} | * '''2019''' | US state law | {{#lst:Current and possible laws and their application|Texas2019}} | ||
* '''2019''' | US state law | {{#lst:Current and possible laws and their application|Virginia2019}} | |||
* '''2019''' | US state law | | |||
{{ | |||
* '''2019''' | science and demonstration | [https://arxiv.org/pdf/1905.09773.pdf ''''Speech2Face: Learning the Face Behind a Voice'''' at arXiv.org] a system for generating likely facial features based on the voice of a person, presented by the [[w:MIT Computer Science and Artificial Intelligence Laboratory]] at the 2019 [[w:Conference on Computer Vision and Pattern Recognition|w:CVPR]]. [https://github.com/saiteja-talluri/Speech2Face Speech2Face at github.com] This may develop to something that really causes problems. [https://neurohive.io/en/news/speech2face-neural-network-predicts-the-face-behind-a-voice/ "Speech2Face: Neural Network Predicts the Face Behind a Voice" reporing at neurohive.io], [https://belitsoft.com/speech-recognition-software-development/speech2face "Speech2Face Sees Voices and Hears Faces: Dreams Come True with AI" reporting at belitsoft.com] | * '''2019''' | science and demonstration | [https://arxiv.org/pdf/1905.09773.pdf ''''Speech2Face: Learning the Face Behind a Voice'''' at arXiv.org] a system for generating likely facial features based on the voice of a person, presented by the [[w:MIT Computer Science and Artificial Intelligence Laboratory]] at the 2019 [[w:Conference on Computer Vision and Pattern Recognition|w:CVPR]]. [https://github.com/saiteja-talluri/Speech2Face Speech2Face at github.com] This may develop to something that really causes problems. [https://neurohive.io/en/news/speech2face-neural-network-predicts-the-face-behind-a-voice/ "Speech2Face: Neural Network Predicts the Face Behind a Voice" reporing at neurohive.io], [https://belitsoft.com/speech-recognition-software-development/speech2face "Speech2Face Sees Voices and Hears Faces: Dreams Come True with AI" reporting at belitsoft.com] | ||