Human Generated Data

Title

Untitled (group gathered for birthday party)
Date

c. 1950
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2272

Human Generated Data

Title

Untitled (group gathered for birthday party)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2272

Machine Generated Data

Tags

Amazon
created on 2022-01-30

Chair 99.8
Furniture 99.8
Person 99
Human 99
Person 97
Person 95.2
Person 94.9
Person 94
Person 91.2
Crowd 90.6
Person 89.6
Person 86.7
Person 80.7
Meal 79.5
Food 79.5
Person 77.8
Person 77.1
Person 74.9
Tablecloth 74.2
Clothing 74.2
Apparel 74.2
Person 71.4
Table 68.6
People 66
Indoors 64.8
Audience 61.4
Person 61.3
Person 60.6
Person 60
Stage 58.6
Room 57.1
Restaurant 55.6
Dish 55.6
Person 52.2

Clarifai
created on 2023-10-29

people 99.6
music 98.8
group 96.7
musician 95.7
man 93.7
group together 93.2
adult 92.6
leader 90.9
child 90.7
woman 88.3
many 87.8
education 86.8
drum 80.1
room 79.5
chair 79.3
indoors 77.4
percussion instrument 77.1
singer 75.7
furniture 74.9
instrument 72.3

Imagga
created on 2022-01-30

room 52.2
hall 46.3
classroom 38.8
interior 34.5
chair 30.3
table 30.3
teacher 29
modern 24.5
center 23.5
restaurant 21.5
house 20.9
people 20.6
educator 19.1
professional 19
home 16.7
business 16.4
men 16.3
office 16
adult 15.9
women 15.8
indoors 15.8
person 15.3
design 15.2
floor 14.9
man 14.8
group 14.5
furniture 14.3
male 14.2
indoor 13.7
work 13.4
dining 13.3
decor 13.2
dinner 12.6
glass 12.4
seat 11.6
businessman 11.5
light 11.4
food 10.9
wood 10.8
counter 10.7
urban 10.5
education 10.4
window 10.3
corporate 10.3
architecture 10.1
decoration 10.1
inside 10.1
building 10.1
space 10.1
life 9.9
stool 9.9
tables 9.8
conference 9.8
cafeteria 9.7
sitting 9.4
drink 9.2
kitchen 8.9
chairs 8.8
happy 8.8
crowd 8.6
blackboard 8.6
residential 8.6
comfortable 8.6
empty 8.6
meeting 8.5
communication 8.4
elegance 8.4
coffee 8.3
service 8.3
city 8.3
bar 8.3
silhouette 8.3
style 8.1
new 8.1
team 8.1
success 8
day 7.8
scene 7.8
luxury 7.7
desk 7.5
contemporary 7.5
student 7.4
holding 7.4
meal 7.3
lifestyle 7.2
portrait 7.1
job 7.1
structure 7.1

Google
created on 2022-01-30

Table 90.3
Black 89.5
Chair 89.4
Black-and-white 85.1
Style 83.9
Line 81.7
Suit 78.5
Monochrome photography 75.5
Monochrome 75.4
Event 73.3
Art 69.7
Room 66.7
Tablecloth 63.9
Stock photography 63.1
Rectangle 62.8
History 58.9
Painting 52.6
Function hall 51.6
Font 51.3

Microsoft
created on 2022-01-30

person 95
window 90.8
table 84.3
clothing 84.1
white 64.1
old 64.1
man 57.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 19-27
Gender Male, 95.8%
Calm 81.5%
Sad 12.6%
Confused 2.8%
Happy 0.9%
Angry 0.7%
Disgusted 0.7%
Surprised 0.5%
Fear 0.4%

AWS Rekognition

Age 10-18
Gender Female, 61.5%
Sad 64.1%
Calm 30.1%
Confused 3%
Happy 1.2%
Angry 0.7%
Disgusted 0.4%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 26-36
Gender Male, 93.7%
Calm 97.7%
Sad 0.8%
Angry 0.7%
Surprised 0.3%
Disgusted 0.2%
Confused 0.1%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 4-10
Gender Female, 92.3%
Fear 94.4%
Sad 3.8%
Surprised 0.5%
Calm 0.4%
Confused 0.3%
Disgusted 0.2%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 16-22
Gender Female, 99.6%
Calm 94.7%
Sad 2.1%
Angry 1.1%
Fear 0.7%
Confused 0.6%
Surprised 0.3%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 14-22
Gender Male, 64.4%
Calm 76.7%
Sad 11%
Happy 7.8%
Confused 1.7%
Angry 1.6%
Fear 0.4%
Surprised 0.4%
Disgusted 0.3%

AWS Rekognition

Age 26-36
Gender Male, 68.6%
Calm 91.9%
Sad 2.4%
Fear 1.6%
Confused 1.4%
Angry 0.9%
Surprised 0.6%
Happy 0.6%
Disgusted 0.6%

AWS Rekognition

Age 28-38
Gender Male, 99.5%
Calm 81.5%
Sad 12.5%
Disgusted 2.5%
Angry 1%
Confused 0.9%
Happy 0.6%
Fear 0.6%
Surprised 0.3%

AWS Rekognition

Age 0-3
Gender Female, 86.2%
Calm 64.4%
Angry 16.5%
Sad 8%
Surprised 5.7%
Disgusted 2.3%
Confused 1.7%
Fear 0.8%
Happy 0.6%

AWS Rekognition

Age 23-31
Gender Female, 72.7%
Calm 84.5%
Sad 9.4%
Happy 4.1%
Angry 0.7%
Confused 0.6%
Surprised 0.3%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 23-31
Gender Female, 52.2%
Happy 35.1%
Calm 17.8%
Surprised 12.1%
Sad 9.7%
Disgusted 7.1%
Angry 6.9%
Fear 5.7%
Confused 5.5%

AWS Rekognition

Age 33-41
Gender Female, 74.6%
Sad 64.5%
Calm 28.1%
Angry 2.4%
Happy 1.6%
Confused 1.1%
Disgusted 1%
Fear 1%
Surprised 0.3%

AWS Rekognition

Age 34-42
Gender Male, 75.1%
Confused 49.5%
Sad 30.3%
Calm 12%
Fear 4.1%
Angry 1.5%
Disgusted 1.3%
Happy 0.7%
Surprised 0.7%

AWS Rekognition

Age 38-46
Gender Female, 76.8%
Confused 48.7%
Calm 19.2%
Sad 15.2%
Angry 4.6%
Fear 4.5%
Happy 3.7%
Surprised 2.8%
Disgusted 1.3%

AWS Rekognition

Age 22-30
Gender Female, 85.8%
Calm 71.2%
Sad 17.6%
Happy 5.1%
Fear 3.4%
Confused 1.1%
Angry 0.7%
Disgusted 0.5%
Surprised 0.4%

AWS Rekognition

Age 18-26
Gender Male, 71.1%
Calm 95.1%
Sad 3.2%
Fear 0.4%
Happy 0.4%
Angry 0.4%
Confused 0.3%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 22-30
Gender Female, 92.4%
Calm 86.4%
Happy 5.8%
Sad 4.4%
Confused 1.9%
Angry 0.6%
Disgusted 0.5%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 16-22
Gender Male, 72.9%
Calm 65.6%
Sad 20.5%
Confused 4.3%
Angry 2.5%
Surprised 2.4%
Fear 2.1%
Happy 1.5%
Disgusted 1.1%

AWS Rekognition

Age 25-35
Gender Male, 96.1%
Sad 95.6%
Fear 1.4%
Calm 1.2%
Confused 1%
Happy 0.2%
Disgusted 0.2%
Angry 0.2%
Surprised 0.1%

AWS Rekognition

Age 23-31
Gender Male, 60%
Sad 50.8%
Calm 37.3%
Happy 3.9%
Confused 2.7%
Angry 2.5%
Fear 1.3%
Surprised 0.8%
Disgusted 0.8%

AWS Rekognition

Age 18-26
Gender Male, 83%
Sad 80.9%
Calm 8.7%
Confused 6.2%
Happy 1.7%
Fear 1%
Disgusted 0.5%
Angry 0.5%
Surprised 0.4%

AWS Rekognition

Age 39-47
Gender Male, 89.9%
Calm 92.6%
Sad 4.7%
Confused 0.8%
Happy 0.8%
Fear 0.5%
Angry 0.2%
Disgusted 0.2%
Surprised 0.2%

AWS Rekognition

Age 22-30
Gender Male, 98.8%
Calm 57.6%
Sad 23.1%
Happy 14.2%
Confused 1.7%
Angry 1.4%
Fear 1.1%
Disgusted 0.7%
Surprised 0.4%

AWS Rekognition

Age 37-45
Gender Male, 96.9%
Calm 55.9%
Sad 30.5%
Happy 8.2%
Confused 2%
Angry 1.1%
Surprised 0.8%
Fear 0.7%
Disgusted 0.7%

AWS Rekognition

Age 10-18
Gender Male, 79.7%
Calm 53.7%
Sad 21.2%
Fear 7.2%
Angry 6.9%
Confused 3.6%
Happy 3.4%
Surprised 2.2%
Disgusted 1.9%

AWS Rekognition

Age 25-35
Gender Female, 85.3%
Calm 41.1%
Sad 24.5%
Happy 22.9%
Fear 4.5%
Angry 2.6%
Confused 2.2%
Disgusted 1.2%
Surprised 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Chair
Person
Chair 99.8%
Person 99%
Person 97%
Person 95.2%
Person 94.9%
Person 94%
Person 91.2%
Person 89.6%
Person 86.7%
Person 80.7%
Person 77.8%
Person 77.1%
Person 74.9%
Person 71.4%
Person 61.3%
Person 60.6%
Person 60%
Person 52.2%

Text analysis

Amazon

have
SSI
SAUOX