Human Generated Data

Title

Untitled (family portrait of fifteen, three boys and baby in front row)

Date

c. 1940

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11269

Human Generated Data

Title

Untitled (family portrait of fifteen, three boys and baby in front row)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

People 99.5
Family 99.5
Human 99.5
Person 98.6
Person 98.5
Person 98.5
Person 98.5
Person 98.1
Person 98
Person 97.9
Person 96.9
Person 96.9
Clothing 96.5
Overcoat 96.5
Coat 96.5
Apparel 96.5
Suit 96.5
Person 96.2
Tie 94.2
Accessories 94.2
Accessory 94.2
Person 93
Person 93
Suit 93
Suit 92.2
Person 90.2
Suit 89.9
Tie 88.8
Tie 81.3
Tie 72.8

Imagga
created on 2022-01-23

kin 100
people 32.3
man 31.6
male 29.9
person 29.2
group 26.6
adult 22.8
men 21.4
happy 20.7
family 19.6
businessman 19.4
couple 18.3
business 18.2
women 18.2
portrait 17.5
team 17
professional 16.8
smiling 16.6
businesswoman 16.3
happiness 15.7
together 14
golfer 14
teamwork 13.9
lifestyle 13.7
two 13.5
love 13.4
player 13
standing 13
room 12.7
job 12.4
black 12.3
meeting 12.2
fashion 12
corporate 12
executive 12
youth 11.9
silhouette 11.6
attractive 11.2
girls 10.9
cheerful 10.6
businesspeople 10.4
boy 10.4
mother 10.1
dress 9.9
child 9.9
new 9.7
success 9.6
office 9.6
bride 9.6
model 9.3
smile 9.3
groom 9.3
wedding 9.2
successful 9.1
pretty 9.1
fun 9
working 8.8
contestant 8.8
home 8.8
husband 8.6
wife 8.5
face 8.5
modern 8.4
occupation 8.2
human 8.2
style 8.2
lady 8.1
worker 8.1
nurse 7.9
work 7.8
colleagues 7.8
classroom 7.7
partner 7.7
sitting 7.7
partnership 7.7
studio 7.6
females 7.6
world 7.6
pair 7.5
elegance 7.5
friends 7.5
holding 7.4
pose 7.2
suit 7.2
active 7.2
kid 7.1

Google
created on 2022-01-23

Footwear 98.1
Photograph 94.2
Dress 90.6
Standing 86.4
Curtain 82.1
Suit 82.1
Vintage clothing 75
Collar 74.8
Crew 74.4
Snapshot 74.3
Formal wear 73.8
Event 73.3
Team 72.3
Monochrome 70.3
Family taking photos together 69.4
Tie 68.3
Blazer 66.7
Fun 65.7
History 65.1
One-piece garment 64.8

Microsoft
created on 2022-01-23

person 100
posing 99.9
group 98.1
clothing 96.4
wall 96.1
smile 95.3
standing 95.1
man 83.4
text 83.2
suit 76
people 64
team 63.9
step 25.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-14
Gender Female, 96.8%
Calm 99.7%
Sad 0.1%
Confused 0.1%
Surprised 0%
Angry 0%
Fear 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 38-46
Gender Male, 100%
Calm 95.5%
Happy 1.1%
Confused 1.1%
Disgusted 0.9%
Surprised 0.6%
Angry 0.5%
Fear 0.2%
Sad 0.1%

AWS Rekognition

Age 1-7
Gender Male, 100%
Calm 51.4%
Sad 47.9%
Confused 0.3%
Angry 0.1%
Happy 0.1%
Fear 0.1%
Disgusted 0.1%
Surprised 0%

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Happy 62.5%
Calm 30.1%
Confused 2.5%
Sad 1.9%
Surprised 1.2%
Disgusted 0.8%
Angry 0.5%
Fear 0.5%

AWS Rekognition

Age 2-8
Gender Male, 99.8%
Calm 99.9%
Confused 0%
Sad 0%
Surprised 0%
Happy 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 37-45
Gender Male, 100%
Calm 88.2%
Happy 9.3%
Surprised 0.8%
Disgusted 0.6%
Fear 0.5%
Angry 0.4%
Confused 0.3%
Sad 0.1%

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 99.8%
Angry 0.1%
Confused 0%
Happy 0%
Surprised 0%
Sad 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 2-10
Gender Male, 98.9%
Calm 81.3%
Confused 6.3%
Sad 5.7%
Disgusted 2%
Fear 1.9%
Happy 1.4%
Angry 1%
Surprised 0.5%

AWS Rekognition

Age 36-44
Gender Female, 99.9%
Calm 99.5%
Surprised 0.1%
Happy 0.1%
Confused 0.1%
Sad 0.1%
Angry 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 47-53
Gender Female, 99.9%
Calm 99%
Happy 0.3%
Surprised 0.2%
Angry 0.2%
Disgusted 0.1%
Sad 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 53-61
Gender Male, 97.3%
Calm 99.1%
Confused 0.9%
Angry 0%
Sad 0%
Surprised 0%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 40-48
Gender Female, 100%
Calm 99.5%
Happy 0.2%
Surprised 0.1%
Angry 0.1%
Confused 0%
Disgusted 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 35-43
Gender Female, 100%
Calm 93.4%
Happy 4.1%
Sad 0.5%
Confused 0.5%
Angry 0.4%
Surprised 0.4%
Fear 0.3%
Disgusted 0.3%

AWS Rekognition

Age 7-17
Gender Male, 99.5%
Calm 99.5%
Confused 0.2%
Surprised 0.1%
Disgusted 0.1%
Sad 0.1%
Angry 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 0-4
Gender Female, 84.3%
Calm 88%
Happy 2.3%
Surprised 2.2%
Sad 2.2%
Fear 1.9%
Angry 1.6%
Disgusted 1.3%
Confused 0.6%

Microsoft Cognitive Services

Age 51
Gender Female

Microsoft Cognitive Services

Age 35
Gender Female

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 53
Gender Female

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 48
Gender Female

Microsoft Cognitive Services

Age 4
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Suit 96.5%
Tie 94.2%

Captions

Microsoft

Herbert Eugene Bolton et al. posing for a photo 99.2%
Herbert Eugene Bolton et al. posing for the camera 99.1%
Herbert Eugene Bolton et al. posing for a picture 99%