Human Generated Data

Title

Untitled (family reunion portrait in living room)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3028

Human Generated Data

Title

Untitled (family reunion portrait in living room)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-21

Person 99.5
Human 99.5
Person 99.4
Person 99
Shoe 98.7
Apparel 98.7
Footwear 98.7
Clothing 98.7
Person 98.7
Person 98.4
Person 98.3
Person 98.1
Person 97.3
Tie 96.4
Accessory 96.4
Accessories 96.4
Person 93.8
Person 91.6
Tie 87.3
Person 83.5
Indoors 81.2
Crowd 78.3
Shoe 77.3
Room 75.3
Person 75.1
People 72.3
Suit 71
Coat 71
Overcoat 71
Person 70
Person 68.6
Shirt 66.5
Face 65.9
Person 65.5
Tie 64.3
Person 63.3
Stage 62.1
Clinic 59.3
Dress 57.7
School 57.7
Classroom 57.7
Audience 56.5

Imagga
created on 2022-01-21

man 39
person 37
people 35.7
nurse 35.5
businessman 33.5
male 33.3
professional 29.3
business 27.9
men 26.6
group 25.8
team 25.1
adult 24.9
happy 22.5
couple 21.8
office 20.1
kin 19.7
smiling 19.5
teamwork 19.5
women 19
businesswoman 18.2
worker 18.1
job 17.7
businesspeople 17.1
success 16.1
colleagues 15.5
meeting 15.1
work 14.9
together 14.9
corporate 14.6
smile 14.2
happiness 14.1
occupation 13.7
silhouette 13.2
cheerful 13
room 12.7
two 12.7
suit 12.6
brass 12.4
standing 12.2
cornet 12.1
player 12.1
executive 12
golfer 11.8
portrait 11.6
teacher 11.4
successful 11
talking 10.4
doctor 10.3
sitting 10.3
wind instrument 10.2
communication 10.1
patient 9.9
modern 9.8
handsome 9.8
human 9.7
working 9.7
medical 9.7
cooperation 9.7
boss 9.6
desk 9.4
friends 9.4
manager 9.3
life 9.1
confident 9.1
employee 9.1
coworkers 8.8
home 8.8
love 8.7
lifestyle 8.7
30s 8.7
partnership 8.6
blackboard 8.6
career 8.5
mature 8.4
sport 8.2
hospital 8.2
bride 8.1
family 8
associates 7.9
boy 7.8
black 7.8
workers 7.8
staff 7.7
partner 7.7
contestant 7.7
groom 7.7
joy 7.5
friendship 7.5
leisure 7.5
musical instrument 7.4
wedding 7.4
computer 7.2
looking 7.2
idea 7.1

Google
created on 2022-01-21

Microsoft
created on 2022-01-21

clothing 97.4
person 96.4
text 91.5
man 91.1
group 59.1
footwear 56.9
woman 51
old 49.5
posing 39

Face analysis

Amazon

Google

AWS Rekognition

Age 52-60
Gender Male, 99.9%
Sad 47.5%
Happy 16%
Calm 12.2%
Confused 8.4%
Angry 6.7%
Fear 4.4%
Surprised 2.4%
Disgusted 2.4%

AWS Rekognition

Age 35-43
Gender Male, 89.6%
Happy 59.4%
Sad 27.3%
Disgusted 4%
Angry 2.6%
Calm 2.4%
Surprised 2.2%
Fear 1.3%
Confused 0.9%

AWS Rekognition

Age 41-49
Gender Male, 98.9%
Calm 98%
Happy 0.5%
Disgusted 0.4%
Sad 0.3%
Surprised 0.3%
Angry 0.2%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 45-51
Gender Male, 59.1%
Surprised 79.9%
Sad 11.2%
Happy 3.9%
Confused 2.1%
Calm 1%
Angry 0.7%
Disgusted 0.6%
Fear 0.5%

AWS Rekognition

Age 26-36
Gender Male, 93.1%
Calm 94.4%
Surprised 2.7%
Angry 0.9%
Happy 0.7%
Confused 0.4%
Disgusted 0.4%
Fear 0.3%
Sad 0.2%

AWS Rekognition

Age 48-56
Gender Male, 98%
Calm 61.3%
Happy 36.3%
Sad 0.8%
Confused 0.6%
Disgusted 0.4%
Surprised 0.4%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 51-59
Gender Male, 68.5%
Calm 53%
Happy 18.5%
Sad 13.6%
Surprised 3.4%
Disgusted 3.3%
Fear 3%
Confused 2.8%
Angry 2.3%

AWS Rekognition

Age 42-50
Gender Male, 95.9%
Sad 93.2%
Happy 2.5%
Calm 1.4%
Confused 1.2%
Surprised 0.9%
Disgusted 0.3%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 51-59
Gender Male, 96.6%
Calm 64.3%
Confused 21.8%
Happy 5%
Sad 4.8%
Angry 1.6%
Disgusted 1.1%
Fear 0.7%
Surprised 0.7%

AWS Rekognition

Age 41-49
Gender Female, 77.1%
Happy 39%
Calm 35.1%
Sad 17.4%
Confused 2.8%
Disgusted 2.4%
Angry 1.7%
Fear 0.9%
Surprised 0.6%

AWS Rekognition

Age 26-36
Gender Male, 99.9%
Sad 42.7%
Happy 41.7%
Angry 7.8%
Calm 3.7%
Surprised 1.6%
Fear 1.1%
Disgusted 0.9%
Confused 0.5%

AWS Rekognition

Age 45-53
Gender Male, 99.7%
Calm 73.3%
Sad 15.3%
Happy 8.3%
Angry 0.7%
Fear 0.7%
Disgusted 0.6%
Surprised 0.6%
Confused 0.4%

AWS Rekognition

Age 35-43
Gender Male, 98.8%
Happy 38.5%
Sad 16.8%
Angry 15.2%
Confused 12.6%
Surprised 6.9%
Disgusted 5.5%
Calm 3.1%
Fear 1.4%

AWS Rekognition

Age 45-53
Gender Male, 99%
Sad 70.4%
Happy 21.8%
Confused 4.9%
Calm 0.8%
Disgusted 0.8%
Angry 0.5%
Surprised 0.4%
Fear 0.4%

AWS Rekognition

Age 43-51
Gender Male, 99.8%
Happy 46.6%
Sad 32.8%
Confused 9.6%
Disgusted 3.9%
Angry 2.9%
Surprised 1.8%
Calm 1.7%
Fear 0.7%

AWS Rekognition

Age 45-51
Gender Male, 99%
Happy 90.4%
Sad 8.3%
Calm 0.3%
Angry 0.3%
Confused 0.3%
Surprised 0.2%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 23-33
Gender Female, 87.3%
Happy 91.5%
Calm 7.3%
Sad 0.7%
Confused 0.2%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 53-61
Gender Male, 92.2%
Calm 47.5%
Confused 43.3%
Sad 3.1%
Surprised 2.5%
Happy 1.6%
Angry 0.7%
Disgusted 0.6%
Fear 0.5%

AWS Rekognition

Age 41-49
Gender Male, 99.8%
Sad 59.4%
Happy 14.8%
Confused 11.7%
Calm 7.1%
Disgusted 3.5%
Surprised 1.8%
Angry 1.3%
Fear 0.5%

AWS Rekognition

Age 43-51
Gender Male, 97.6%
Happy 51.6%
Calm 46.6%
Surprised 0.4%
Disgusted 0.4%
Sad 0.3%
Confused 0.3%
Fear 0.2%
Angry 0.1%

AWS Rekognition

Age 50-58
Gender Male, 86.6%
Happy 34.6%
Sad 29.6%
Calm 15.2%
Confused 9.9%
Angry 4.9%
Disgusted 2.9%
Surprised 1.7%
Fear 1.2%

AWS Rekognition

Age 49-57
Gender Male, 98.5%
Sad 77.8%
Calm 7.3%
Happy 4.9%
Surprised 3.7%
Angry 2%
Confused 2%
Fear 1.4%
Disgusted 1%

AWS Rekognition

Age 31-41
Gender Male, 99.8%
Sad 46.9%
Calm 15.7%
Happy 12.8%
Disgusted 10.1%
Surprised 7.8%
Confused 2.9%
Angry 2.3%
Fear 1.6%

AWS Rekognition

Age 45-51
Gender Female, 59.9%
Fear 28.6%
Happy 26.4%
Calm 25.4%
Sad 8.3%
Confused 6.4%
Disgusted 2.2%
Angry 1.6%
Surprised 1.1%

AWS Rekognition

Age 26-36
Gender Female, 85.2%
Happy 33.5%
Calm 31.7%
Surprised 21.6%
Sad 6.5%
Angry 2.1%
Disgusted 1.8%
Fear 1.6%
Confused 1.2%

AWS Rekognition

Age 34-42
Gender Female, 97.2%
Sad 48.9%
Happy 31.5%
Calm 10.5%
Surprised 3.7%
Angry 1.7%
Confused 1.5%
Fear 1.3%
Disgusted 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Shoe 98.7%
Tie 96.4%

Captions

Microsoft

a group of people posing for a photo 87.2%
a group of people standing in front of a crowd 86.7%
a group of people standing in front of a crowd posing for the camera 82.5%

Text analysis

Amazon

...