Human Generated Data

Title

Untitled (family portrait in living room, two children on floor in front of man in wheelchair)

Date

c. 1955

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10358

Human Generated Data

Title

Untitled (family portrait in living room, two children on floor in front of man in wheelchair)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Accessories 100
Accessory 100
Tie 100
Tie 99.7
Person 99.2
Human 99.2
Tie 99
Person 98.3
Person 98.2
Person 98.2
Person 98.1
Person 98
People 97.9
Family 97.3
Person 96.9
Person 96.9
Person 96.9
Person 96.3
Person 95.1
Person 94.8
Person 94.5
Apparel 92.2
Clothing 92.2
Shoe 92.2
Footwear 92.2
Tie 91.9
Person 91.5
Person 91.4
Person 90.8
Overcoat 90.7
Suit 90.7
Coat 90.7
Shoe 89.9
Tie 87.3
Suit 77.7
Sitting 73.7
Suit 70
Tie 68.5
Crowd 66.2
Furniture 56.6
Couch 56.6
Person 54.3
Shoe 52.8

Imagga
created on 2022-01-23

kin 100
people 35.7
person 30
man 29.6
group 29
businessman 26.5
male 26.3
adult 23.7
happy 23.2
business 23.1
professional 21.9
smiling 21
women 19
team 18.8
portrait 18.8
smile 18.5
men 18
together 16.6
fashion 16.6
job 15.9
teamwork 15.8
family 15.1
businesswoman 14.5
work 14.1
happiness 14.1
mother 13.8
success 13.7
diversity 13.4
child 13.4
black 13.3
attractive 13.3
office 12.8
nurse 12.7
style 12.6
worker 12.4
couple 12.2
corporate 12
fun 12
successful 11.9
pretty 11.9
suit 11.7
meeting 11.3
standing 11.3
love 11
dress 10.8
room 10.8
working 10.6
cheerful 10.6
sexy 10.4
friends 10.3
executive 10.1
girls 10
silhouette 9.9
handsome 9.8
home 9.6
two 9.3
face 9.2
occupation 9.2
holding 9.1
lady 8.9
daughter 8.9
brunette 8.7
partner 8.7
boy 8.7
lifestyle 8.7
education 8.7
crowd 8.6
classroom 8.6
model 8.5
businesspeople 8.5
casual 8.5
friendship 8.4
modern 8.4
kid 8
cute 7.9
workers 7.8
sitting 7.7
student 7.7
staff 7.6
elegance 7.6
human 7.5
manager 7.4
teen 7.3
20s 7.3
new 7.3

Google
created on 2022-01-23

Photograph 94.3
Coat 91.5
Dress 86.3
Suit 82.7
People 78.9
Formal wear 76.2
Snapshot 74.3
Blazer 74.3
Event 73.6
Family reunion 72.8
Team 72.1
Classic 68.7
Vintage clothing 68.6
Chair 67.1
Monochrome 66
Room 65.9
Sitting 65.8
History 65.1
Stock photography 62.8
White-collar worker 57.5

Microsoft
created on 2022-01-23

person 100
posing 99
wall 98.3
clothing 97.7
group 96.3
smile 96
man 92.4
footwear 86.2
woman 85.9
dress 82
suit 78.3
people 69.9
text 61.7
team 46.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-43
Gender Male, 99.9%
Happy 81.3%
Calm 15.6%
Surprised 1%
Angry 0.6%
Confused 0.5%
Fear 0.4%
Sad 0.3%
Disgusted 0.3%

AWS Rekognition

Age 23-33
Gender Female, 100%
Happy 93.7%
Angry 3.3%
Confused 1%
Surprised 0.6%
Disgusted 0.6%
Fear 0.3%
Sad 0.3%
Calm 0.2%

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 93.4%
Happy 3.1%
Surprised 0.8%
Confused 0.8%
Disgusted 0.6%
Angry 0.5%
Fear 0.4%
Sad 0.4%

AWS Rekognition

Age 36-44
Gender Male, 99.6%
Happy 43.8%
Calm 40%
Confused 4.9%
Surprised 4.5%
Angry 2.9%
Fear 1.9%
Disgusted 1.2%
Sad 0.8%

AWS Rekognition

Age 13-21
Gender Female, 98.3%
Calm 99.3%
Disgusted 0.2%
Happy 0.1%
Angry 0.1%
Sad 0.1%
Surprised 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 6-14
Gender Female, 90.9%
Happy 98.4%
Surprised 0.7%
Calm 0.4%
Fear 0.1%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%
Sad 0%

AWS Rekognition

Age 64-74
Gender Female, 96.1%
Calm 98.2%
Surprised 0.5%
Happy 0.4%
Angry 0.3%
Disgusted 0.2%
Sad 0.2%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 23-31
Gender Female, 92.5%
Happy 44.4%
Calm 29.7%
Surprised 6%
Confused 4.9%
Angry 4.8%
Sad 4%
Disgusted 3.7%
Fear 2.6%

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Calm 99.5%
Happy 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0%
Surprised 0%
Fear 0%
Sad 0%

AWS Rekognition

Age 50-58
Gender Female, 100%
Calm 92.6%
Happy 2.4%
Surprised 2.3%
Fear 0.8%
Sad 0.6%
Disgusted 0.5%
Angry 0.4%
Confused 0.4%

AWS Rekognition

Age 0-3
Gender Male, 99.8%
Calm 99.8%
Sad 0.1%
Happy 0.1%
Surprised 0%
Confused 0%
Disgusted 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 51-59
Gender Female, 100%
Calm 99.6%
Confused 0.1%
Angry 0.1%
Surprised 0.1%
Disgusted 0%
Fear 0%
Sad 0%
Happy 0%

AWS Rekognition

Age 2-8
Gender Male, 99.8%
Happy 98.9%
Calm 0.6%
Surprised 0.2%
Sad 0.1%
Confused 0.1%
Angry 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Calm 56.3%
Angry 17.1%
Confused 11.4%
Disgusted 4.5%
Fear 3.6%
Sad 3.3%
Happy 2.5%
Surprised 1.3%

AWS Rekognition

Age 22-30
Gender Female, 98.3%
Happy 65.7%
Confused 13.7%
Calm 8.3%
Surprised 6.8%
Fear 2%
Angry 1.9%
Disgusted 0.9%
Sad 0.6%

AWS Rekognition

Age 69-79
Gender Male, 100%
Calm 95.2%
Surprised 4%
Angry 0.3%
Happy 0.2%
Confused 0.2%
Disgusted 0.1%
Fear 0.1%
Sad 0%

Microsoft Cognitive Services

Age 40
Gender Male

Microsoft Cognitive Services

Age 71
Gender Male

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 18
Gender Female

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 50
Gender Female

Microsoft Cognitive Services

Age 40
Gender Male

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 68
Gender Female

Microsoft Cognitive Services

Age 0
Gender Male

Microsoft Cognitive Services

Age 20
Gender Female

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 47
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 100%
Person 99.2%
Shoe 92.2%
Suit 90.7%

Captions

Microsoft

a group of people posing for a photo 98.7%
a group of people posing for the camera 98.6%
a group of people posing for a picture 98.5%