Human Generated Data

Title

Untitled (birthday party attendees seated behind cake table)

Date

c. 1945

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1127

Human Generated Data

Title

Untitled (birthday party attendees seated behind cake table)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Chair 99.8
Furniture 99.8
Tablecloth 99.6
Person 99.5
Human 99.5
Person 97.2
Person 96.5
Chair 96.4
Person 95.9
Person 95.2
Person 94.5
Person 94.2
Table 93.3
Person 93
Room 92.7
Indoors 92.7
Dining Table 91.8
Person 91.6
Person 90.6
Restaurant 89.4
Food 88.5
Meal 88.5
Person 87.1
Person 81.2
Home Decor 80.6
Reception 79.8
Reception Room 79.8
Waiting Room 79.8
Person 75.6
Person 75.2
Person 73.6
Person 65.2
People 64.3
Hall 64.3
Crowd 63.3
Dining Room 60.5
Person 60.1
Linen 58.8
Dish 56.4
Person 53.2

Imagga
created on 2022-01-23

teacher 64.9
educator 46.9
room 46
table 37.2
professional 36.9
interior 36.2
chair 32.2
restaurant 26.9
person 26.8
modern 26.6
adult 26.4
classroom 25.4
people 21.2
man 18.8
indoors 18.4
male 18.4
furniture 18.1
home 17.5
house 17.5
women 16.6
office 16.5
business 16.4
dining 16.2
meeting 16
dinner 16
men 15.5
hall 15.4
design 15.2
businessman 15
work 14.9
happy 13.8
sitting 13.7
team 13.4
wood 13.3
musical instrument 13.3
together 13.1
group 12.9
indoor 12.8
food 12.7
floor 12.1
corporate 12
inside 12
percussion instrument 11.8
tables 11.8
chairs 11.7
drink 11.7
glass 11.7
life 11.1
light 10.7
meal 10.5
talking 10.4
desk 10.4
waiter 10.3
empty 10.3
luxury 10.3
teamwork 10.2
smiling 10.1
lifestyle 10.1
businesswoman 10
worker 9.9
lunch 9.8
conference 9.8
decor 9.7
style 9.6
couple 9.6
contemporary 9.4
architecture 9.4
manager 9.3
service 9.3
kitchen 9.1
cafeteria 9.1
stool 8.9
success 8.8
executive 8.7
seat 8.7
education 8.7
comfortable 8.6
counter 8.6
smile 8.5
communication 8.4
eat 8.4
mature 8.4
wine 8.3
suit 8.1
job 8
decoration 8
student 7.9
colleagues 7.8
marimba 7.7
eating 7.6
presentation 7.4
window 7.3
portrait 7.1

Google
created on 2022-01-23

Furniture 94.7
Coat 92
Chair 89.6
Suit 86.9
Table 83.1
Event 74.2
Monochrome photography 68.9
Monochrome 67.9
Tablecloth 67.8
Plant 67.7
Vintage clothing 65.1
Room 63.5
History 63.5
Shade 55.8
Team 53
Collaboration 52.5
Function hall 52.1

Microsoft
created on 2022-01-23

indoor 96.2
table 93.3
person 91.2
clothing 82.9
text 70.1
furniture 60.6
man 58.7
old 49.6
clothes 17.7
several 12.2
dining room 7.7

Face analysis

Amazon

Google

AWS Rekognition

Age 52-60
Gender Female, 92.1%
Happy 85.1%
Surprised 7.6%
Angry 4.2%
Disgusted 0.8%
Fear 0.7%
Confused 0.5%
Calm 0.5%
Sad 0.5%

AWS Rekognition

Age 54-64
Gender Female, 99.9%
Calm 93%
Happy 3.7%
Angry 0.8%
Sad 0.7%
Confused 0.6%
Disgusted 0.6%
Surprised 0.4%
Fear 0.2%

AWS Rekognition

Age 77-87
Gender Female, 95.8%
Calm 92.8%
Confused 2.3%
Sad 2.2%
Happy 0.9%
Disgusted 0.5%
Surprised 0.4%
Angry 0.4%
Fear 0.4%

AWS Rekognition

Age 53-61
Gender Female, 99.8%
Calm 95.1%
Confused 2%
Angry 1.1%
Fear 0.9%
Disgusted 0.3%
Sad 0.3%
Surprised 0.2%
Happy 0.1%

AWS Rekognition

Age 73-83
Gender Female, 72.5%
Happy 99.8%
Fear 0%
Surprised 0%
Calm 0%
Sad 0%
Disgusted 0%
Angry 0%
Confused 0%

AWS Rekognition

Age 72-82
Gender Female, 89.7%
Happy 92.5%
Calm 4.7%
Angry 0.7%
Surprised 0.5%
Sad 0.5%
Disgusted 0.4%
Confused 0.4%
Fear 0.2%

AWS Rekognition

Age 37-45
Gender Male, 89.6%
Happy 61.7%
Surprised 28.2%
Fear 3.2%
Calm 2.6%
Confused 1.7%
Angry 1.1%
Disgusted 1%
Sad 0.4%

AWS Rekognition

Age 60-70
Gender Female, 57.3%
Calm 75.4%
Disgusted 8.5%
Happy 7.5%
Angry 2.5%
Surprised 2.3%
Sad 1.6%
Confused 1.5%
Fear 0.7%

AWS Rekognition

Age 38-46
Gender Female, 96.2%
Calm 44.8%
Sad 38.2%
Angry 4%
Disgusted 3.7%
Fear 3.4%
Surprised 2.8%
Happy 2%
Confused 1.1%

AWS Rekognition

Age 56-64
Gender Male, 99.7%
Calm 73.4%
Disgusted 12.1%
Sad 4.3%
Angry 4%
Happy 3.2%
Surprised 1.2%
Confused 1%
Fear 0.9%

AWS Rekognition

Age 49-57
Gender Female, 98.5%
Sad 41.5%
Happy 32.3%
Calm 17.8%
Disgusted 4.7%
Angry 1.8%
Confused 0.8%
Fear 0.6%
Surprised 0.6%

AWS Rekognition

Age 53-61
Gender Female, 99.3%
Calm 94.7%
Sad 2.5%
Happy 0.7%
Angry 0.7%
Disgusted 0.4%
Confused 0.3%
Fear 0.3%
Surprised 0.3%

AWS Rekognition

Age 53-61
Gender Male, 98.7%
Happy 80.7%
Calm 15.5%
Surprised 0.8%
Angry 0.8%
Confused 0.7%
Sad 0.7%
Disgusted 0.6%
Fear 0.3%

AWS Rekognition

Age 28-38
Gender Male, 99.1%
Calm 91.6%
Confused 4.3%
Sad 2.7%
Happy 0.4%
Angry 0.4%
Fear 0.3%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 62-72
Gender Male, 94.5%
Calm 99.9%
Sad 0%
Surprised 0%
Disgusted 0%
Happy 0%
Angry 0%
Fear 0%
Confused 0%

AWS Rekognition

Age 53-61
Gender Male, 95.1%
Calm 94.1%
Angry 1.8%
Happy 1.2%
Sad 1%
Disgusted 0.7%
Confused 0.5%
Surprised 0.5%
Fear 0.3%

AWS Rekognition

Age 71-81
Gender Female, 90.2%
Calm 96.9%
Happy 1.5%
Surprised 0.6%
Confused 0.4%
Disgusted 0.2%
Angry 0.2%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 14-22
Gender Male, 55%
Calm 73.5%
Surprised 4.5%
Happy 4%
Disgusted 4%
Confused 3.9%
Fear 3.5%
Sad 3.4%
Angry 3%

AWS Rekognition

Age 68-78
Gender Female, 77.9%
Calm 99.3%
Angry 0.2%
Disgusted 0.2%
Sad 0.1%
Confused 0.1%
Surprised 0.1%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 61-71
Gender Male, 100%
Calm 48.7%
Surprised 23.2%
Happy 12.1%
Confused 9.8%
Fear 2%
Angry 1.4%
Disgusted 1.4%
Sad 1.4%

AWS Rekognition

Age 68-78
Gender Female, 96.7%
Happy 98.2%
Calm 0.8%
Angry 0.3%
Surprised 0.3%
Disgusted 0.1%
Fear 0.1%
Sad 0.1%
Confused 0.1%

AWS Rekognition

Age 51-59
Gender Male, 81.4%
Calm 98.6%
Sad 0.4%
Happy 0.4%
Confused 0.3%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 52-60
Gender Female, 99.9%
Confused 74.9%
Angry 11.5%
Calm 7.2%
Happy 1.7%
Surprised 1.5%
Sad 1.3%
Disgusted 1.3%
Fear 0.6%

AWS Rekognition

Age 68-78
Gender Male, 100%
Calm 99.4%
Happy 0.3%
Disgusted 0.1%
Sad 0.1%
Confused 0%
Surprised 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 71-81
Gender Female, 99.7%
Happy 36.4%
Angry 21.9%
Calm 18.4%
Sad 11.7%
Surprised 4.1%
Disgusted 3.4%
Confused 2.4%
Fear 1.6%

AWS Rekognition

Age 78-88
Gender Male, 95.2%
Calm 93.9%
Sad 2.7%
Confused 1%
Angry 0.9%
Surprised 0.5%
Happy 0.4%
Disgusted 0.4%
Fear 0.2%

AWS Rekognition

Age 54-64
Gender Male, 98.8%
Calm 57.9%
Happy 28.8%
Angry 4.3%
Fear 2.5%
Disgusted 2.2%
Surprised 2.1%
Sad 1.5%
Confused 0.7%

AWS Rekognition

Age 39-47
Gender Male, 82%
Happy 97.3%
Calm 1%
Sad 0.7%
Surprised 0.3%
Disgusted 0.2%
Angry 0.2%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 69-79
Gender Female, 80.7%
Calm 90.7%
Happy 4.1%
Confused 3.7%
Sad 0.7%
Surprised 0.3%
Fear 0.2%
Disgusted 0.2%
Angry 0.2%

AWS Rekognition

Age 58-66
Gender Male, 70.1%
Calm 77%
Sad 7.9%
Fear 4%
Surprised 3.5%
Confused 3%
Disgusted 2.2%
Happy 1.5%
Angry 0.8%

AWS Rekognition

Age 21-29
Gender Male, 69.4%
Sad 37.6%
Calm 22.3%
Confused 21.8%
Angry 7.7%
Surprised 4.6%
Fear 2.8%
Disgusted 1.9%
Happy 1.4%

AWS Rekognition

Age 37-45
Gender Female, 81.4%
Calm 77.6%
Confused 8%
Disgusted 5%
Sad 3.5%
Surprised 2.2%
Fear 2.1%
Angry 1.1%
Happy 0.5%

AWS Rekognition

Age 54-64
Gender Male, 77.3%
Calm 86.9%
Sad 3.4%
Confused 3.2%
Happy 3.2%
Fear 1.3%
Angry 0.8%
Disgusted 0.7%
Surprised 0.6%

AWS Rekognition

Age 54-64
Gender Female, 88.7%
Happy 97.5%
Calm 1.7%
Surprised 0.2%
Fear 0.2%
Disgusted 0.2%
Sad 0.1%
Angry 0.1%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Chair 99.8%
Person 99.5%
Dining Table 91.8%

Captions

Microsoft

a group of people standing in a room 94.3%
a group of people in a room 94.2%
an old photo of a group of people standing in a room 89.7%

Text analysis

Amazon

PROOF

Google

PROOF
PROOF