Human Generated Data

Title

Untitled (large family, parents, children, grandchildren)

Date

1956

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18637

Human Generated Data

Title

Untitled (large family, parents, children, grandchildren)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1956

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Person 98.5
Human 98.5
Person 98.3
Room 98.2
Indoors 98.2
Person 98
Person 98
Person 97.8
Person 96.6
Person 95.6
Person 95.5
School 95.2
Classroom 95.2
Person 94.1
Person 93.8
Person 93.8
Person 93.2
Person 92
Person 88.5
Person 87.9
People 84.3
Person 82.9
Accessories 77.6
Accessory 77.6
Tie 77.6
Person 77.2
Kindergarten 76.5
Person 71.1

Imagga
created on 2022-02-25

kin 34.8
people 32.3
man 24.9
person 20.1
couple 20
male 19.9
happy 17.5
women 17.4
business 17
room 16.7
child 16.4
group 16.1
two 16.1
men 15.4
adult 15.3
family 14.2
world 13.8
businessman 13.2
professional 13.2
portrait 12.9
dress 12.6
teacher 12.6
happiness 12.5
bride 12.5
interior 12.4
smiling 12.3
office 12.3
shop 11.4
together 11.4
standing 11.3
home 11.2
wedding 11
groom 10.6
indoors 10.5
classroom 10
girls 10
fashion 9.8
life 9.6
building 9.6
love 9.5
corporate 9.4
executive 9.2
holding 9.1
old 9.1
fun 9
cheerful 8.9
romantic 8.9
kid 8.9
success 8.8
job 8.8
education 8.7
holiday 8.6
smile 8.5
bouquet 8.5
friends 8.4
window 8.4
city 8.3
indoor 8.2
style 8.2
decoration 8.1
new 8.1
celebration 8
to 8
mother 8
black 7.9
work 7.8
face 7.8
blackboard 7.7
youth 7.7
husband 7.6
wife 7.6
desk 7.6
traditional 7.5
worker 7.5
employee 7.3
businesswoman 7.3
color 7.2
educator 7.2
school 7.2

Google
created on 2022-02-25

Microsoft
created on 2022-02-25

text 99
person 98.2
clothing 97.9
human face 96.8
wall 95.8
indoor 95.1
smile 91.6
group 72.6
child 70.4
posing 67.5
people 64.5
boy 61.2
woman 55.9
school 52.4
old 50.8
family 32.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 37-45
Gender Male, 100%
Happy 35.3%
Calm 29.7%
Sad 20.2%
Surprised 4.6%
Angry 3.5%
Fear 2.6%
Disgusted 2.2%
Confused 1.9%

AWS Rekognition

Age 2-8
Gender Male, 60%
Calm 98.2%
Confused 1%
Angry 0.3%
Sad 0.2%
Surprised 0.1%
Disgusted 0.1%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 6-14
Gender Male, 100%
Happy 99.3%
Confused 0.2%
Calm 0.2%
Surprised 0.1%
Angry 0%
Disgusted 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 6-14
Gender Male, 99.9%
Happy 99.4%
Surprised 0.3%
Fear 0.2%
Angry 0.1%
Sad 0%
Disgusted 0%
Confused 0%
Calm 0%

AWS Rekognition

Age 6-14
Gender Female, 100%
Happy 99.2%
Calm 0.3%
Sad 0.1%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%
Confused 0%
Fear 0%

AWS Rekognition

Age 25-35
Gender Female, 100%
Angry 76.7%
Happy 16.2%
Disgusted 2.2%
Surprised 2.1%
Fear 1.3%
Sad 0.6%
Calm 0.5%
Confused 0.4%

AWS Rekognition

Age 2-8
Gender Male, 99.9%
Happy 73%
Calm 22.5%
Confused 2.5%
Angry 0.6%
Disgusted 0.5%
Sad 0.4%
Surprised 0.4%
Fear 0.1%

AWS Rekognition

Age 41-49
Gender Female, 100%
Happy 96.2%
Surprised 1.8%
Angry 0.7%
Disgusted 0.7%
Calm 0.2%
Fear 0.2%
Confused 0.1%
Sad 0.1%

AWS Rekognition

Age 51-59
Gender Male, 99.5%
Calm 99.6%
Happy 0.1%
Surprised 0.1%
Confused 0%
Angry 0%
Disgusted 0%
Fear 0%
Sad 0%

AWS Rekognition

Age 6-16
Gender Female, 99.9%
Calm 65.9%
Happy 33.1%
Angry 0.2%
Sad 0.2%
Surprised 0.2%
Disgusted 0.2%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 2-10
Gender Female, 99.7%
Calm 94.4%
Sad 1.7%
Happy 1.3%
Disgusted 0.7%
Angry 0.6%
Surprised 0.5%
Fear 0.5%
Confused 0.3%

AWS Rekognition

Age 6-14
Gender Female, 100%
Calm 88.1%
Angry 8.8%
Sad 1.3%
Fear 0.7%
Confused 0.5%
Surprised 0.2%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 27-37
Gender Female, 99.9%
Calm 77.3%
Happy 6.1%
Surprised 5.4%
Angry 5.1%
Fear 3.3%
Disgusted 1.3%
Confused 0.8%
Sad 0.6%

AWS Rekognition

Age 51-59
Gender Male, 100%
Calm 26.2%
Angry 25.1%
Sad 15.6%
Confused 10.8%
Disgusted 7.6%
Surprised 6.9%
Happy 5.4%
Fear 2.5%

AWS Rekognition

Age 4-12
Gender Female, 100%
Calm 81.9%
Happy 14.6%
Confused 0.7%
Surprised 0.6%
Fear 0.6%
Angry 0.6%
Disgusted 0.5%
Sad 0.5%

AWS Rekognition

Age 41-49
Gender Male, 100%
Happy 96.4%
Surprised 1.1%
Confused 0.6%
Sad 0.6%
Fear 0.4%
Angry 0.4%
Disgusted 0.4%
Calm 0.1%

AWS Rekognition

Age 0-6
Gender Female, 65.8%
Calm 99.9%
Confused 0.1%
Disgusted 0%
Angry 0%
Surprised 0%
Sad 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Surprised 52.8%
Happy 16.5%
Sad 8.7%
Fear 8.2%
Angry 5.3%
Calm 3.5%
Disgusted 3.2%
Confused 1.8%

AWS Rekognition

Age 0-4
Gender Female, 99.7%
Calm 95.9%
Surprised 1.7%
Angry 0.8%
Sad 0.5%
Fear 0.4%
Confused 0.4%
Disgusted 0.3%
Happy 0.1%

AWS Rekognition

Age 43-51
Gender Female, 100%
Calm 39.2%
Confused 32%
Happy 15%
Surprised 5.3%
Sad 4.1%
Angry 1.9%
Disgusted 1.3%
Fear 1.3%

Microsoft Cognitive Services

Age 57
Gender Male

Microsoft Cognitive Services

Age 61
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Tie 77.6%

Captions

Microsoft

a group of people posing for a photo 95.9%
a group of people posing for a picture 95.8%
a group of people posing for the camera 95.7%

Text analysis

Google

एसस्साL-
एसस्साL- 罪