Human Generated Data

Title

Untitled (four children outside)
Date

c. 1970
People

Artist: Bachrach Studios, founded 1868
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.541

Human Generated Data

Title

Untitled (four children outside)

People

Artist: Bachrach Studios, founded 1868

Date

c. 1970

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.541

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 99.9
Apparel 99.9
Person 99.9
Human 99.9
Shoe 99.9
Footwear 99.9
Shorts 99.8
Person 99.8
Shoe 99.8
Shoe 99.8
Shoe 99.7
Person 99.7
Shoe 99.1
Person 96.3
Shoe 94.9
People 86.3
Coat 67.5
Girl 66
Female 66
Kid 58.7
Child 58.7
Jacket 58.4
Home Decor 58.2
Architecture 57.7
Building 57.7
Overcoat 55.2

Clarifai
created on 2023-10-29

child 99.9
girl 99.7
people 99.1
son 98.9
portrait 98.5
wear 98.4
family 97.5
group 97.4
boy 97.2
woman 95.8
dress 95.2
facial expression 94.6
sibling 92.9
music 92.3
school 92
offspring 91.3
adult 91.3
recreation 90
fun 89.9
two 89

Imagga
created on 2022-02-26

kin 43.1
man 42.4
happy 40.8
male 40.1
smiling 39.8
people 38
couple 35.7
together 34.2
group 33.1
family 32
adult 25.4
person 25
senior 24.4
men 24.1
mature 23.3
husband 23
smile 22.8
businesswoman 21.8
team 21.5
love 21.3
businessman 21.2
standing 20.9
lifestyle 20.3
portrait 19.4
wife 19
mother 18.8
child 18.4
boy 18.3
happiness 18
father 17.9
school 17.7
business 17.6
professional 17.6
women 17.4
married 17.3
grandma 17
friends 16.9
fun 16.5
suit 16.4
businesspeople 16.1
outdoors 15.7
30s 15.4
indoors 14.9
sibling 14.9
teamwork 14.9
meeting 14.1
home 13.6
casual 13.6
blond 13.4
attractive 13.3
relationship 13.1
cheerful 13
handsome 12.5
daughter 12.5
elderly 12.5
park 12.4
office 12.1
three 12.1
success 12.1
corporate 12
sitting 12
looking 12
grandfather 12
children 11.9
dad 11.6
friendship 11.2
building 11.2
outside 11.1
leisure 10.8
businessmen 10.7
colleagues 10.7
retired 10.7
retirement 10.6
education 10.4
two 10.2
camera 10.2
20s 10.1
clothing 10.1
parent 10
romance 9.8
kid 9.8
hug 9.7
laughing 9.5
togetherness 9.4
active 9.3
summer 9
grandmother 8.8
parents 8.8
40s 8.8
staff 8.6
student 8.6
loving 8.6
enjoying 8.5
son 8.5
adults 8.5
outdoor 8.4
manager 8.4
holding 8.3
job 8
working 8
businesswomen 7.9
work 7.9
60s 7.8
students 7.8
spectator 7.8
thirties 7.8
partners 7.8
conversation 7.8
having 7.8
pretty 7.7
looking camera 7.7
old 7.7
communication 7.6
horizontal 7.5
executive 7.4
occupation 7.3
confident 7.3
grass 7.1
day 7.1

Google
created on 2022-02-26

Footwear 98.2
Shoe 95.4
Leg 92.8
Tartan 90.2
People in nature 89.1
Sleeve 87.2
Shorts 86.4
Gesture 85.3
Baby & toddler clothing 81.3
Tie 80.9
Happy 80.1
Blazer 78.2
Sky 77.8
Waist 77.2
Plaid 76.4
Toddler 74.9
Vintage clothing 74.6
Formal wear 72.5
Knee 72.1
Sock 71.7

Microsoft
created on 2022-02-26

person 100
clothing 98.1
smile 96.5
boy 92.7
human face 90.5
standing 86.7
toddler 84.9
footwear 66.9
crowd 1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 98.6%
Sad 77%
Confused 17.4%
Calm 2.2%
Happy 1.4%
Angry 0.7%
Disgusted 0.6%
Surprised 0.4%
Fear 0.2%

AWS Rekognition

Age 6-14
Gender Male, 99.8%
Sad 60.5%
Angry 23.6%
Confused 8.8%
Calm 3.7%
Disgusted 1.6%
Surprised 0.7%
Fear 0.7%
Happy 0.4%

AWS Rekognition

Age 10-18
Gender Male, 99.3%
Calm 92.2%
Sad 2.6%
Surprised 2.5%
Angry 1.1%
Disgusted 0.7%
Fear 0.5%
Confused 0.3%
Happy 0.2%

Microsoft Cognitive Services

Age 6
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Person 99.9%
Person 99.8%
Person 99.7%
Person 96.3%
Shoe 99.9%
Shoe 99.8%
Shoe 99.8%
Shoe 99.7%
Shoe 99.1%
Shoe 94.9%

Categories

Imagga

people portraits 71.6%
events parties 27.5%