Human Generated Data

Title

Ralph Allen taking an affidavit from Carolyn Daniels in Terrill County

Date

1962, printed 2010

People

Artist: Danny Lyon, American born 1942

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Gift, 2013.109

Copyright

© Danny Lyon/Magnum Photos

Human Generated Data

Title

Ralph Allen taking an affidavit from Carolyn Daniels in Terrill County

People

Artist: Danny Lyon, American born 1942

Date

1962, printed 2010

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 99.6
Person 99.6
Person 99.5
Person 98.4
Person 93.5
Indoors 80
Interior Design 76.9
Room 71.6
Sitting 66.1
Clothing 62.3
Apparel 62.3
Face 60.8
Furniture 58
Bedroom 57.3
Bed 55

Clarifai
created on 2018-02-09

people 99.6
man 98.2
adult 96.9
monochrome 96.5
woman 96.5
group 95.4
group together 93.5
chair 91.2
sit 90.9
two 90.8
furniture 89.5
four 89.3
desk 88.3
room 87
several 85.6
administration 82.3
five 82.2
indoors 82.1
three 80.9
sitting 76.7

Imagga
created on 2018-02-09

television 96.2
man 30.9
office 26.9
business 26.1
computer 25.7
male 25.5
monitor 24.5
businessman 22.9
people 22.9
person 22.8
laptop 22.2
broadcasting 20
working 18.6
desk 18.4
sitting 16.3
work 15.7
adult 15.6
telecommunication 14.9
corporate 14.6
black 14.4
smiling 12.3
executive 12.2
one 11.9
portrait 11.6
equipment 11.4
professional 11.3
back 11
suit 11
worker 10.7
chair 10.5
men 10.3
call 10.3
expression 10.2
medium 9.9
silhouette 9.9
attractive 9.8
job 9.7
looking 9.6
room 9.5
career 9.5
happy 9.4
light 9.4
smile 9.3
communication 9.2
face 9.2
indoor 9.1
modern 9.1
businesswoman 9.1
center 8.8
couple 8.7
keyboard 8.4
senior 8.4
manager 8.4
holding 8.3
interior 8
table 7.9
telephone 7.8
corporation 7.7
window 7.6
hand 7.6
tie 7.6
college 7.6
technology 7.4
phone 7.4

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

person 98.8
indoor 95.4
man 91
window 82.9
people 63

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 97.9%
Surprised 3%
Happy 4%
Confused 2.8%
Angry 13.5%
Disgusted 31.1%
Calm 28.3%
Sad 17.3%

AWS Rekognition

Age 26-43
Gender Female, 88.2%
Calm 45.2%
Disgusted 7.2%
Angry 6%
Happy 15.2%
Confused 2.6%
Surprised 3.9%
Sad 19.9%

Microsoft Cognitive Services

Age 40
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people standing in front of a window 84.5%
a group of people sitting in front of a window 76.5%
a group of people in front of a window 76.4%

Text analysis

Google

BEST
THE BEST
THE