Human Generated Data

Title

Baby on Floor (with Media), Republican National Convention, Dallas

Date

1984

People

Artist: Richard Gordon, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of the artist, 2.2002.1836

Human Generated Data

Title

Baby on Floor (with Media), Republican National Convention, Dallas

People

Artist: Richard Gordon, American 20th century

Date

1984

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.2
Human 99.2
Person 98.9
Person 97.5
Person 95
Person 94.3
Clinic 86.1
Finger 72
People 70.9
Helmet 67.8
Clothing 67.8
Apparel 67.8

Imagga
created on 2021-12-14

photographer 37.8
man 32.9
male 23.4
equipment 23
people 19.5
person 18.7
helmet 17.6
car 16
work 15.7
television camera 15.5
machinist 14.7
uniform 14.7
vehicle 14.4
color 13.9
men 13.7
adult 13.6
automobile 12.4
clothing 12.4
television equipment 12.4
device 12.3
mask 12.2
sport 12
black 12
football helmet 11.7
worker 11.6
weapon 11.2
occupation 11
danger 10.9
camera 10.8
transportation 10.8
driver 10.7
hand 10.6
driving 10.6
military 10.6
wheel 10.4
professional 10.2
safety 10.1
protection 10
electronic equipment 9.8
job 9.7
working 9.7
repair 9.6
drive 9.5
portrait 9.1
motorcycle 8.9
metal 8.8
megaphone 8.8
women 8.7
engine 8.7
angle 8.6
fire 8.4
power 8.4
focus 8.3
human 8.2
technology 8.2
business 7.9
soldier 7.8
army 7.8
headdress 7.8
motor 7.7
war 7.7
emergency 7.7
skill 7.7
industry 7.7
machine 7.6
adults 7.6
hot 7.5
service 7.4
light 7.3
tool 7.3
road 7.2
acoustic device 7.1

Microsoft
created on 2021-12-14

text 99.8
person 99.7
clothing 97.1
black and white 88.6
man 85.2
player 62.7
poster 57.7
human face 54.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 37-55
Gender Female, 99.3%
Happy 93.2%
Calm 3.3%
Surprised 1.3%
Fear 0.7%
Sad 0.7%
Angry 0.3%
Confused 0.3%
Disgusted 0.2%

AWS Rekognition

Age 26-40
Gender Male, 89.8%
Calm 98.6%
Happy 0.9%
Confused 0.1%
Sad 0.1%
Fear 0.1%
Surprised 0.1%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 22-34
Gender Female, 67.8%
Calm 97.7%
Angry 0.7%
Surprised 0.5%
Happy 0.4%
Disgusted 0.3%
Confused 0.2%
Sad 0.2%
Fear 0%

AWS Rekognition

Age 28-44
Gender Female, 71.6%
Calm 71.3%
Sad 16%
Happy 8.3%
Angry 1.7%
Disgusted 1.6%
Fear 0.5%
Surprised 0.3%
Confused 0.2%

AWS Rekognition

Age 0-3
Gender Female, 97.9%
Calm 93.1%
Sad 3.4%
Fear 1.2%
Angry 0.7%
Surprised 0.5%
Confused 0.4%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 52-70
Gender Female, 85.2%
Calm 95.5%
Sad 2.9%
Disgusted 0.7%
Angry 0.3%
Happy 0.3%
Confused 0.2%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 24-38
Gender Male, 50.7%
Calm 92.6%
Sad 6.2%
Happy 0.6%
Angry 0.3%
Fear 0.1%
Confused 0.1%
Surprised 0.1%
Disgusted 0%

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Helmet 67.8%

Captions

Microsoft

a group of people in uniform 77.2%
a group of men riding on the back of a man 45.3%
a man in a uniform 45.2%

Text analysis

Amazon

REAGAN
8
ИАЗАЗЯ
Sau

Google

REAGAN
REAGAN MADA
MADA