Human Generated Data

Title

Untitled (group gathered for portrait)

Date

1950

People

Artist: Hamblin Studio, American active 1930s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2049

Human Generated Data

Title

Untitled (group gathered for portrait)

People

Artist: Hamblin Studio, American active 1930s

Date

1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Accessory 99.4
Tie 99.4
Accessories 99.4
Person 99.2
Human 99.2
Person 99
Person 98.4
Person 98.3
Person 97
Person 97
Person 96.2
Person 96.1
People 95.8
Person 93.6
Person 93.2
Person 92.9
Apparel 92.5
Clothing 92.5
Tie 91
Indoors 90.3
Room 88.2
Person 85.9
Workshop 85.2
Coat 82.7
Suit 82.7
Overcoat 82.7
Person 81.4
Person 79.9
Chair 76.9
Furniture 76.9
Person 76.4
Person 75.8
Female 73.6
Dress 71.2
Family 69.9
Person 67.7
Person 66.4
Person 65.5
Stage 63.8
Child 60.8
Kid 60.8
Person 60.8
Photo 60.6
Photography 60.6
Crowd 59.3
Long Sleeve 56.7
Sleeve 56.7
School 55.8
Living Room 55.3

Imagga
created on 2021-12-14

room 39.9
person 36.7
teacher 35.8
classroom 34.7
professional 33.5
people 33.5
group 29.8
man 28.9
men 28.3
adult 28.1
women 27.7
business 27.3
male 26.9
businessman 24.7
educator 24.7
team 24.2
work 22.8
interior 21.2
corporate 20.6
dancer 20.5
modern 19.6
happy 19.4
table 19
office 18.5
chair 18
meeting 16.9
job 16.8
performer 16.4
indoors 15.8
life 15.3
teamwork 14.8
executive 14.7
worker 14.5
smiling 13.7
lifestyle 13.7
indoor 13.7
portrait 13.6
together 13.1
brass 12.8
suit 12.6
entertainer 12.4
smile 12.1
success 12.1
home 12
hall 11.8
businesswoman 11.8
communication 11.8
house 11.7
desk 11.3
wind instrument 11.2
silhouette 10.8
boss 10.5
human 10.5
urban 10.5
furniture 10.5
career 10.4
sitting 10.3
student 10.3
manager 10.2
floor 10.2
casual 10.2
successful 10.1
employee 10
class 9.6
nurse 9.6
design 9.6
boy 9.6
occupation 9.2
gymnasium 9
couple 8.7
education 8.7
musical instrument 8.6
day 8.6
happiness 8.6
businesspeople 8.5
mature 8.4
inside 8.3
holding 8.2
light 8
working 7.9
outfit 7.9
standing 7.8
conference 7.8
architecture 7.8
luxury 7.7
motion 7.7
diversity 7.7
crowd 7.7
two 7.6
talking 7.6
company 7.4
style 7.4
window 7.3
cheerful 7.3
girls 7.3
board 7.2
activity 7.2
handsome 7.1

Google
created on 2021-12-14

Product 90.8
Black-and-white 84.3
Style 83.8
Font 79.4
Chair 78
Art 75
Snapshot 74.3
Event 73.2
Monochrome photography 73
Monochrome 71.8
Room 68.5
Team 66.8
Suit 63.5
Stock photography 62.3
Visual arts 59.7
Crew 59.7
Sitting 58.7
Rectangle 58.6
Advertising 56.1
History 53.4

Microsoft
created on 2021-12-14

person 91.1
clothing 78.6
text 59.8
furniture 58.6
chair 52.2
old 51.1

Face analysis

Amazon

Google

AWS Rekognition

Age 26-40
Gender Male, 76%
Calm 93.4%
Sad 5.6%
Happy 0.5%
Confused 0.2%
Angry 0.1%
Surprised 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 44-62
Gender Female, 85.2%
Calm 60.9%
Sad 20.4%
Angry 7.8%
Happy 6%
Confused 2.2%
Surprised 1.7%
Fear 0.6%
Disgusted 0.4%

AWS Rekognition

Age 46-64
Gender Male, 79.9%
Happy 87.4%
Calm 9.7%
Sad 2%
Surprised 0.4%
Confused 0.3%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 44-62
Gender Male, 90.4%
Calm 72.5%
Sad 12.2%
Angry 7%
Confused 4.2%
Happy 2%
Surprised 1.3%
Disgusted 0.6%
Fear 0.2%

AWS Rekognition

Age 18-30
Gender Female, 62.6%
Sad 95.6%
Calm 3.3%
Confused 0.3%
Fear 0.3%
Angry 0.3%
Happy 0.2%
Surprised 0.1%
Disgusted 0%

AWS Rekognition

Age 33-49
Gender Female, 52.3%
Calm 53%
Happy 31.1%
Sad 12.1%
Angry 1.5%
Confused 1.2%
Surprised 0.7%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 39-57
Gender Male, 59.2%
Calm 72.7%
Happy 10%
Sad 5.8%
Surprised 5.5%
Angry 3.2%
Confused 1.8%
Fear 0.6%
Disgusted 0.2%

AWS Rekognition

Age 49-67
Gender Female, 55.7%
Sad 87.6%
Calm 7.7%
Happy 3.6%
Angry 0.5%
Fear 0.2%
Confused 0.2%
Surprised 0.1%
Disgusted 0%

AWS Rekognition

Age 21-33
Gender Female, 72.2%
Happy 50.4%
Calm 30.3%
Sad 16.2%
Angry 1.8%
Confused 0.6%
Surprised 0.3%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 32-48
Gender Male, 63.5%
Happy 40.2%
Sad 34%
Calm 22%
Confused 1.9%
Surprised 1.1%
Angry 0.4%
Fear 0.3%
Disgusted 0.2%

AWS Rekognition

Age 49-67
Gender Male, 88.5%
Calm 66.7%
Sad 28.2%
Happy 2.6%
Confused 1.7%
Surprised 0.4%
Angry 0.3%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 31-47
Gender Female, 52.5%
Sad 46.8%
Calm 46.5%
Happy 3.5%
Confused 1.7%
Angry 0.6%
Fear 0.3%
Surprised 0.3%
Disgusted 0.1%

AWS Rekognition

Age 33-49
Gender Male, 74.8%
Happy 53.9%
Sad 26.7%
Calm 17.9%
Surprised 0.5%
Confused 0.4%
Angry 0.2%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 39-57
Gender Female, 77.4%
Happy 29.6%
Calm 26%
Sad 19.6%
Surprised 12.7%
Fear 4.3%
Angry 3.3%
Confused 3%
Disgusted 1.5%

AWS Rekognition

Age 13-23
Gender Male, 84.4%
Sad 86.6%
Calm 6.8%
Confused 3.1%
Angry 2.5%
Happy 0.5%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 46-64
Gender Male, 75.6%
Sad 80.6%
Calm 14.3%
Confused 2.5%
Happy 0.7%
Surprised 0.6%
Disgusted 0.5%
Angry 0.4%
Fear 0.4%

AWS Rekognition

Age 22-34
Gender Female, 86.2%
Calm 65%
Sad 26.9%
Happy 5.5%
Surprised 1.1%
Confused 0.8%
Angry 0.5%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 45-63
Gender Male, 82.5%
Sad 52.6%
Calm 18.6%
Fear 12.8%
Happy 4.5%
Angry 4%
Surprised 3.8%
Confused 2.5%
Disgusted 1.4%

AWS Rekognition

Age 22-34
Gender Female, 55.6%
Sad 41.2%
Calm 28%
Happy 26.6%
Surprised 1.2%
Angry 1.1%
Confused 1%
Fear 0.5%
Disgusted 0.4%

AWS Rekognition

Age 46-64
Gender Female, 51.9%
Calm 38.9%
Sad 36.1%
Surprised 11.1%
Confused 6.1%
Fear 4.3%
Angry 1.7%
Happy 1.2%
Disgusted 0.5%

AWS Rekognition

Age 47-65
Gender Female, 77.7%
Sad 97.9%
Calm 1.4%
Fear 0.2%
Happy 0.2%
Surprised 0.1%
Confused 0.1%
Angry 0.1%
Disgusted 0%

AWS Rekognition

Age 33-49
Gender Male, 95.8%
Calm 71.9%
Happy 14.5%
Sad 9.4%
Surprised 2.1%
Angry 1.5%
Confused 0.3%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 23-35
Gender Male, 73.4%
Happy 49.2%
Calm 33.8%
Sad 11.8%
Angry 3.4%
Confused 0.6%
Surprised 0.6%
Disgusted 0.5%
Fear 0.1%

AWS Rekognition

Age 37-55
Gender Female, 63.8%
Happy 90.8%
Calm 3.7%
Sad 3.5%
Surprised 0.7%
Confused 0.6%
Angry 0.3%
Fear 0.3%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.4%
Person 99.2%

Captions

Microsoft

a group of people standing in a room 89%
a group of people in a room 88.9%
a group of people that are standing in a room 83.7%