Human Generated Data

Title

Untitled (group portrait of thirteen men)

Date

1960s

People

Artist: Bachrach Studios, founded 1868

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.526

Human Generated Data

Title

Untitled (group portrait of thirteen men)

People

Artist: Bachrach Studios, founded 1868

Date

1960s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Apparel 99.8
Clothing 99.8
Shoe 99.2
Footwear 99.2
Coat 99.1
Overcoat 99.1
Human 97.9
Person 97.9
Person 97.1
Person 97
Person 97
Person 96.5
Shoe 96.3
Person 96.2
Person 95.8
Person 95.7
Person 94.9
Person 94.6
Person 94.4
Jacket 93.8
Blazer 93.8
Person 92.9
Tuxedo 92.6
Person 91.2
Sitting 89.7
Suit 82.5
Suit 82.3
People 80.3
Suit 79.2
Outdoors 77.1
Shoe 76.4
Suit 74.7
Furniture 74.7
Chair 74.7
Shoe 69.9
Nature 69.8
Military Uniform 69.1
Military 69.1
Suit 68.5
Crowd 66.2
Evening Dress 62.7
Robe 62.7
Gown 62.7
Fashion 62.7
Person 62.7
Soldier 62.7
Suit 62.6
Pants 59.3
Tie 58.9
Accessory 58.9
Accessories 58.9
Countryside 58.5
Dress 57.4
Officer 55.9
Female 55.7
Man 55.3
Suit 51.9

Imagga
created on 2022-02-26

group 50.7
team 44.8
student 44.5
person 42.8
people 41.2
businessman 40.6
man 38.3
male 37.6
business 36.4
men 34.3
happy 33.8
teamwork 33.3
smiling 33.3
businesswoman 28.1
corporate 27.5
professional 26.3
enrollee 26.3
adult 26.1
colleagues 25.2
success 24.1
staff 24
businesspeople 23.7
smile 23.5
standing 23.4
office 23.4
women 22.9
confident 22.7
businessmen 21.4
job 20.3
together 18.4
work 18
executive 18
manager 17.7
successful 17.4
meeting 16.9
uniform 16.2
suit 16.2
couple 15.7
20s 15.6
friends 15
leadership 14.4
worker 14.3
handsome 14.2
education 13.8
classroom 13.8
lifestyle 13.7
40s 13.6
portrait 13.6
30s 13.5
secretary 12.9
friendly 12.8
workers 12.6
indoors 12.3
school 12.3
students 11.7
diversity 11.5
career 11.3
company 11.2
teacher 11
diverse 10.8
partners 10.7
cooperation 10.6
working 10.6
adults 10.4
friendship 10.3
associates 9.8
businesswomen 9.8
partner 9.6
boss 9.6
ethnic 9.5
innocent 9.5
elegant 9.4
mature 9.3
child 9.2
occupation 9.2
room 9.1
coworkers 8.8
nurse 8.8
partnership 8.6
confidence 8.6
casual 8.5
black 8.4
camera 8.3
positive 8.3
girls 8.2
cheerful 8.1
medical 7.9
five people 7.9
happiness 7.8
25 30 years 7.8
colleague 7.8
entrepreneur 7.7
employment 7.7
corporation 7.7
military uniform 7.5
doctor 7.5
gymnasium 7.5
outdoors 7.5
study 7.4
three 7.4
indoor 7.3
looking 7.2
hospital 7.1

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

person 100
clothing 98
suit 97.6
posing 97
man 96.3
group 96.3
people 91.7
smile 80.6
standing 80.1

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Male, 92.1%
Sad 49.4%
Calm 28.1%
Fear 6.2%
Happy 3.7%
Confused 3.4%
Angry 3.3%
Disgusted 3.1%
Surprised 2.6%

AWS Rekognition

Age 56-64
Gender Male, 98.5%
Calm 40.6%
Happy 34.1%
Sad 10.3%
Confused 5.6%
Fear 2.6%
Surprised 2.5%
Disgusted 2.4%
Angry 1.9%

AWS Rekognition

Age 50-58
Gender Male, 98.1%
Happy 91.8%
Calm 3.1%
Sad 1.1%
Disgusted 1%
Surprised 0.9%
Angry 0.8%
Confused 0.8%
Fear 0.5%

AWS Rekognition

Age 54-64
Gender Male, 88.8%
Calm 91.4%
Surprised 4.2%
Confused 1.5%
Happy 0.9%
Sad 0.8%
Angry 0.7%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 61-71
Gender Male, 100%
Calm 88%
Surprised 2.7%
Angry 2.4%
Disgusted 2.1%
Confused 1.8%
Sad 1.5%
Happy 1.1%
Fear 0.2%

AWS Rekognition

Age 70-80
Gender Male, 100%
Confused 26.7%
Angry 20.8%
Calm 18.7%
Happy 13.6%
Sad 12.4%
Surprised 3.1%
Fear 2.4%
Disgusted 2.3%

AWS Rekognition

Age 54-64
Gender Male, 100%
Calm 76%
Angry 6.2%
Happy 5.1%
Confused 3.8%
Disgusted 3.6%
Fear 2.2%
Sad 1.7%
Surprised 1.4%

AWS Rekognition

Age 63-73
Gender Male, 99.9%
Happy 98.3%
Sad 0.6%
Confused 0.3%
Calm 0.3%
Angry 0.2%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 61-71
Gender Male, 99.9%
Calm 97.4%
Confused 0.9%
Sad 0.5%
Surprised 0.4%
Angry 0.3%
Fear 0.2%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 48-56
Gender Male, 99%
Happy 98.2%
Surprised 0.6%
Calm 0.3%
Angry 0.3%
Confused 0.2%
Fear 0.2%
Disgusted 0.1%
Sad 0.1%

AWS Rekognition

Age 54-62
Gender Male, 100%
Happy 86.8%
Surprised 3.9%
Sad 3.2%
Calm 2.3%
Angry 1.4%
Disgusted 0.9%
Fear 0.8%
Confused 0.7%

AWS Rekognition

Age 61-71
Gender Male, 97.6%
Happy 99.6%
Confused 0.1%
Calm 0.1%
Angry 0.1%
Fear 0.1%
Surprised 0%
Sad 0%
Disgusted 0%

AWS Rekognition

Age 57-65
Gender Male, 100%
Happy 95.4%
Calm 3.9%
Disgusted 0.3%
Confused 0.1%
Angry 0.1%
Surprised 0.1%
Sad 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Shoe 99.2%
Person 97.9%
Suit 82.5%
Tie 58.9%

Captions

Microsoft

a group of people posing for a photo 99.2%
a group of people posing for a picture 99.1%
a group of people posing for the camera 99%

Text analysis

Amazon

<<<<<<<<<<<<<
62