Human Generated Data

Title

Untitled (group gathered for portrait)

Date

1950

People

Artist: Hamblin Studio, American active 1930s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2048

Human Generated Data

Title

Untitled (group gathered for portrait)

People

Artist: Hamblin Studio, American active 1930s

Date

1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 98.8
Human 98.8
Person 98.6
Person 98.4
Person 97.3
Person 97.1
Person 96
Person 94.1
Person 93.7
Person 93.4
Clothing 92.8
Apparel 92.8
Person 92
Person 90.6
Person 90.2
Person 89.8
People 89.5
Accessories 87.7
Tie 87.7
Accessory 87.7
Furniture 86.5
Overcoat 85.6
Coat 85.6
Suit 85.6
Indoors 78
Person 76.5
Person 76.4
Person 75.8
Workshop 75.3
Room 75.1
Person 73
Female 72.5
Stage 69.3
Clinic 68.8
Person 67.6
Table 64.5
Person 60.9
Photo 59.6
Photography 59.6
Chair 59.4
Crowd 56.6
Person 44.1

Imagga
created on 2021-12-14

people 36.8
person 36.2
teacher 35.3
group 33.8
dancer 33.7
professional 31.6
men 30
adult 29.3
performer 27.2
women 25.3
educator 24.3
man 24.2
business 23.7
male 23.4
room 22.9
team 21.5
classroom 20.7
entertainer 20.6
gymnasium 20.3
businessman 20.3
work 19.6
happy 18.8
silhouette 18.2
crowd 16.3
athletic facility 16.3
interior 15.9
corporate 13.7
smiling 13.7
human 13.5
life 13.1
teamwork 13
portrait 12.9
casual 12.7
nurse 12.5
facility 12.2
smile 12.1
office 12
modern 11.9
worker 11.7
student 11.4
urban 11.4
success 11.3
exercise 10.9
dance 10.8
chair 10.5
together 10.5
table 10.4
sitting 10.3
company 10.2
design 10.1
lifestyle 10.1
activity 9.9
job 9.7
indoors 9.7
diversity 9.6
boy 9.6
motion 9.4
meeting 9.4
sport 9.3
city 9.1
children 9.1
fashion 9
black 9
suit 9
students 8.8
art 8.7
light 8.7
class 8.7
day 8.6
architecture 8.6
hall 8.4
communication 8.4
mature 8.4
training 8.3
occupation 8.2
window 8.2
indoor 8.2
active 8.2
girls 8.2
businesswoman 8.2
outfit 8.1
family 8
working 8
happiness 7.8
standing 7.8
education 7.8
silhouettes 7.8
health 7.6
career 7.6
friendship 7.5
fun 7.5
blur 7.4
home 7.2
recreation 7.2

Google
created on 2021-12-14

Black-and-white 85.4
Dress 85.1
Chair 84.8
Style 83.9
Line 82
Font 78.8
Art 76.7
Monochrome 76.3
Monochrome photography 76
Snapshot 74.3
Event 73.4
Suit 71.7
Rectangle 71.5
Room 65.3
Team 65.2
Stock photography 64
Visual arts 60.7
History 58.5
Sitting 55.9
Advertising 53.3

Microsoft
created on 2021-12-14

person 89.6
text 86.3
old 65.6
group 58.9
clothing 56.6

Face analysis

Amazon

Google

AWS Rekognition

Age 23-35
Gender Male, 93.1%
Calm 98.6%
Happy 0.9%
Sad 0.3%
Surprised 0.1%
Confused 0.1%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 36-52
Gender Male, 68.7%
Calm 44%
Happy 24%
Sad 12.8%
Surprised 9%
Angry 5.6%
Confused 3.2%
Fear 0.7%
Disgusted 0.7%

AWS Rekognition

Age 51-69
Gender Female, 90.4%
Calm 59.7%
Happy 24.9%
Sad 10.8%
Confused 2.8%
Surprised 1%
Angry 0.3%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 19-31
Gender Female, 65.9%
Sad 80.2%
Happy 6.1%
Calm 5.6%
Fear 3.5%
Confused 1.8%
Surprised 1.6%
Angry 0.9%
Disgusted 0.3%

AWS Rekognition

Age 47-65
Gender Male, 84.7%
Sad 47.8%
Calm 35.9%
Angry 7.5%
Confused 3.6%
Happy 2.4%
Surprised 2%
Disgusted 0.5%
Fear 0.3%

AWS Rekognition

Age 46-64
Gender Female, 68.4%
Calm 50.8%
Happy 34.4%
Sad 12.7%
Angry 0.8%
Confused 0.6%
Surprised 0.4%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 40-58
Gender Female, 62.8%
Happy 81.4%
Calm 9.5%
Sad 7.1%
Confused 0.7%
Angry 0.4%
Surprised 0.4%
Fear 0.3%
Disgusted 0.1%

AWS Rekognition

Age 37-55
Gender Female, 90.8%
Sad 42.2%
Happy 32.4%
Calm 21.4%
Surprised 1.7%
Confused 1.1%
Fear 0.6%
Angry 0.4%
Disgusted 0.3%

AWS Rekognition

Age 34-50
Gender Male, 95.1%
Happy 62.4%
Calm 28.2%
Sad 3.7%
Surprised 3.2%
Confused 1.7%
Angry 0.4%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 48-66
Gender Male, 62.7%
Calm 55.9%
Sad 37.8%
Confused 3.9%
Angry 1%
Happy 0.8%
Disgusted 0.2%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 42-60
Gender Female, 67.4%
Sad 49.5%
Calm 37.1%
Happy 10.5%
Angry 1.8%
Confused 0.5%
Surprised 0.5%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 24-38
Gender Female, 56.2%
Sad 96.2%
Happy 1.9%
Calm 1.4%
Fear 0.1%
Confused 0.1%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 22-34
Gender Female, 78.1%
Calm 62.8%
Sad 21.3%
Happy 14.7%
Confused 0.3%
Angry 0.3%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 25-39
Gender Male, 65.6%
Calm 84.2%
Sad 10.1%
Happy 4.7%
Angry 0.5%
Confused 0.4%
Surprised 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 13-25
Gender Male, 91.2%
Calm 50.9%
Sad 40.8%
Angry 3.2%
Happy 2.1%
Confused 1.7%
Surprised 0.5%
Fear 0.4%
Disgusted 0.4%

AWS Rekognition

Age 50-68
Gender Female, 70.5%
Sad 71.6%
Calm 19.3%
Happy 2.7%
Surprised 2.4%
Angry 1.7%
Fear 1.1%
Confused 1%
Disgusted 0.3%

AWS Rekognition

Age 47-65
Gender Male, 61.5%
Calm 34.2%
Sad 24%
Fear 21.2%
Surprised 8.5%
Angry 4.6%
Confused 3.7%
Disgusted 2.2%
Happy 1.6%

AWS Rekognition

Age 48-66
Gender Female, 86.6%
Happy 38.7%
Sad 26.9%
Calm 26.8%
Surprised 2.4%
Angry 1.8%
Fear 1.6%
Confused 1.1%
Disgusted 0.8%

AWS Rekognition

Age 50-68
Gender Female, 79.8%
Happy 62.7%
Calm 22.6%
Surprised 6%
Sad 5%
Confused 1.2%
Fear 1.2%
Angry 1.1%
Disgusted 0.3%

AWS Rekognition

Age 21-33
Gender Male, 76.1%
Happy 96.5%
Calm 2.3%
Surprised 0.4%
Sad 0.3%
Confused 0.2%
Angry 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 26-40
Gender Female, 86.5%
Happy 96.8%
Sad 1.8%
Calm 1%
Surprised 0.1%
Confused 0.1%
Angry 0.1%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 51-69
Gender Male, 83.7%
Calm 77.9%
Sad 8.4%
Happy 5.6%
Angry 2.5%
Disgusted 1.8%
Fear 1.4%
Surprised 1.3%
Confused 1%

AWS Rekognition

Age 50-68
Gender Female, 60%
Calm 72.7%
Sad 19.1%
Confused 2.8%
Surprised 2.7%
Happy 2%
Fear 0.3%
Angry 0.2%
Disgusted 0.2%

AWS Rekognition

Age 46-64
Gender Female, 70.2%
Happy 31.2%
Calm 19.6%
Fear 16.6%
Sad 14.6%
Surprised 8.8%
Angry 5.9%
Confused 2.4%
Disgusted 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Tie 87.7%
Chair 59.4%

Captions

Microsoft

a group of people standing in a room 87.7%
a group of people in a room 87.6%
an old photo of a group of people in a room 86.5%