Human Generated Data

Title

Untitled (four children outside)

Date

c. 1970

People

Artist: Bachrach Studios, founded 1868

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.541

Human Generated Data

Title

Untitled (four children outside)

People

Artist: Bachrach Studios, founded 1868

Date

c. 1970

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Apparel 99.9
Clothing 99.9
Human 99.9
Person 99.9
Shoe 99.9
Footwear 99.9
Shorts 99.8
Person 99.8
Shoe 99.8
Shoe 99.8
Shoe 99.7
Person 99.7
Shoe 99.1
Person 96.3
Shoe 94.9
People 86.3
Coat 67.5
Girl 66
Female 66
Kid 58.7
Child 58.7
Jacket 58.4
Home Decor 58.2
Architecture 57.7
Building 57.7
Overcoat 55.2

Imagga
created on 2022-02-26

kin 43.1
man 42.4
happy 40.8
male 40.1
smiling 39.8
people 38
couple 35.7
together 34.2
group 33.1
family 32
adult 25.4
person 25
senior 24.4
men 24.1
mature 23.3
husband 23
smile 22.8
businesswoman 21.8
team 21.5
love 21.3
businessman 21.2
standing 20.9
lifestyle 20.3
portrait 19.4
wife 19
mother 18.8
child 18.4
boy 18.3
happiness 18
father 17.9
school 17.7
business 17.6
professional 17.6
women 17.4
married 17.3
grandma 17
friends 16.9
fun 16.5
suit 16.4
businesspeople 16.1
outdoors 15.7
30s 15.4
indoors 14.9
sibling 14.9
teamwork 14.9
meeting 14.1
home 13.6
casual 13.6
blond 13.4
attractive 13.3
relationship 13.1
cheerful 13
handsome 12.5
daughter 12.5
elderly 12.5
park 12.4
office 12.1
three 12.1
success 12.1
corporate 12
sitting 12
looking 12
grandfather 12
children 11.9
dad 11.6
friendship 11.2
building 11.2
outside 11.1
leisure 10.8
businessmen 10.7
colleagues 10.7
retired 10.7
retirement 10.6
education 10.4
camera 10.2
two 10.2
20s 10.1
clothing 10.1
parent 10
romance 9.8
kid 9.8
hug 9.7
laughing 9.5
togetherness 9.4
active 9.3
summer 9
grandmother 8.8
parents 8.8
40s 8.8
staff 8.6
student 8.6
loving 8.6
enjoying 8.5
son 8.5
adults 8.5
outdoor 8.4
manager 8.4
holding 8.3
job 8
working 8
businesswomen 7.9
work 7.9
60s 7.8
students 7.8
spectator 7.8
thirties 7.8
partners 7.8
conversation 7.8
having 7.8
pretty 7.7
looking camera 7.7
old 7.7
communication 7.6
horizontal 7.5
executive 7.4
occupation 7.3
confident 7.3
grass 7.1
day 7.1

Google
created on 2022-02-26

Footwear 98.2
Shoe 95.4
Leg 92.8
Tartan 90.2
People in nature 89.1
Sleeve 87.2
Shorts 86.4
Gesture 85.3
Baby & toddler clothing 81.3
Tie 80.9
Happy 80.1
Blazer 78.2
Sky 77.8
Waist 77.2
Plaid 76.4
Toddler 74.9
Vintage clothing 74.6
Formal wear 72.5
Knee 72.1
Sock 71.7

Microsoft
created on 2022-02-26

person 100
clothing 98.1
smile 96.5
boy 92.7
human face 90.5
standing 86.7
toddler 84.9
footwear 66.9
crowd 1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 98.6%
Sad 77%
Confused 17.4%
Calm 2.2%
Happy 1.4%
Angry 0.7%
Disgusted 0.6%
Surprised 0.4%
Fear 0.2%

AWS Rekognition

Age 6-14
Gender Male, 99.8%
Sad 60.5%
Angry 23.6%
Confused 8.8%
Calm 3.7%
Disgusted 1.6%
Surprised 0.7%
Fear 0.7%
Happy 0.4%

AWS Rekognition

Age 10-18
Gender Male, 99.3%
Calm 92.2%
Sad 2.6%
Surprised 2.5%
Angry 1.1%
Disgusted 0.7%
Fear 0.5%
Confused 0.3%
Happy 0.2%

Microsoft Cognitive Services

Age 6
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Shoe 99.9%

Captions

Microsoft

a boy standing in front of a group of people posing for the camera 87.4%
a group of people posing for the camera 87.3%
a group of people standing next to a child 87.2%