Human Generated Data

Title

Untitled (group of businessmen)

Date

1950s

People

Artist: Bachrach Studios, founded 1868

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.607

Human Generated Data

Title

Untitled (group of businessmen)

People

Artist: Bachrach Studios, founded 1868

Date

1950s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 98.7
Human 98.7
Person 98.1
Person 97.9
Person 97.7
Person 97.5
Person 97.3
Person 97.2
Sitting 97.1
Person 95.3
Person 95.2
Person 94.9
Person 93.8
Coat 93.3
Clothing 93.3
Apparel 93.3
Suit 93.3
Overcoat 93.3
Person 92.4
Furniture 87
Chair 87
Person 78.9
People 78.1
Crowd 76.9
Military 74.9
Officer 71.6
Military Uniform 71.6
Suit 64.4
Suit 60
Audience 59.5
Indoors 58.8
Room 58.8
Court 56.5
Couch 55.7
Attorney 55.1
Suit 50.3

Imagga
created on 2022-01-23

man 35.6
businessman 30
business 29.1
male 29.1
people 28.4
meeting 28.2
teacher 27.7
group 26.6
adult 26.1
room 24.2
men 24
office 23.7
businesswoman 23.6
person 21.9
professional 21.8
team 21.5
corporate 21.5
classroom 21.4
indoors 20.2
educator 17.4
couple 17.4
musical instrument 17.3
businesspeople 17.1
women 16.6
wind instrument 16.4
indoor 16.4
executive 16.1
chair 15.8
teamwork 15.7
suit 15.6
colleagues 15.5
sitting 15.4
communication 15.1
together 14.9
table 14.7
laptop 14.6
lifestyle 14.4
happy 14.4
computer 13.6
work 13.3
interior 13.3
mature 13
corporation 12.5
happiness 12.5
student 12.4
life 12.4
education 12.1
modern 11.9
two 11.8
discussion 11.7
smiling 11.6
talking 11.4
kin 11.2
businessmen 10.7
handsome 10.7
job 10.6
career 10.4
desk 10.4
senior 10.3
employee 10.2
oboe 10.1
discussing 9.8
diverse 9.8
success 9.6
looking 9.6
day 9.4
uniform 9.3
smile 9.3
occupation 9.2
pretty 9.1
restaurant 8.9
coworkers 8.8
working 8.8
40s 8.8
class 8.7
diversity 8.6
clothing 8.6
manager 8.4
confident 8.2
board 8.1
school 8.1
romantic 8
family 8
home 8
boy 7.8
conference 7.8
color 7.8
attractive 7.7
casual 7.6
adults 7.6
fashion 7.5
worker 7.5
leisure 7.5
technology 7.4
building 7.4
20s 7.3
window 7.3
cheerful 7.3
hall 7.3
girls 7.3
accordion 7.2
brass 7.1
love 7.1

Google
created on 2022-01-23

Footwear 98.1
Coat 88.1
Chair 80.3
Suit 79.4
Crew 73.3
Event 71.9
Vintage clothing 71.3
Classic 68.8
Monochrome 68.4
Sitting 67.4
Room 66.5
History 66.2
Team 64.8
Blazer 62
Formal wear 61.7
Monochrome photography 59.7
Uniform 56.3
White-collar worker 54.8

Microsoft
created on 2022-01-23

person 97.5
clothing 95.9
man 85.8
group 83.6
musical instrument 73.5
posing 55.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-64
Gender Male, 100%
Calm 99.4%
Surprised 0.2%
Sad 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Happy 0%
Fear 0%

AWS Rekognition

Age 52-60
Gender Male, 99.1%
Calm 73.2%
Happy 14.4%
Surprised 5.9%
Angry 1.8%
Confused 1.7%
Fear 1.1%
Disgusted 1%
Sad 1%

AWS Rekognition

Age 58-66
Gender Male, 99.4%
Happy 94.1%
Calm 1.7%
Surprised 1.4%
Angry 0.8%
Fear 0.7%
Disgusted 0.6%
Sad 0.5%
Confused 0.3%

AWS Rekognition

Age 69-79
Gender Male, 54.8%
Happy 95.8%
Calm 2.4%
Confused 0.4%
Surprised 0.4%
Angry 0.3%
Fear 0.3%
Sad 0.2%
Disgusted 0.2%

AWS Rekognition

Age 51-59
Gender Male, 100%
Calm 99.5%
Angry 0.2%
Confused 0.1%
Sad 0.1%
Surprised 0%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 50-58
Gender Male, 100%
Calm 79.8%
Happy 8.8%
Angry 3.6%
Sad 2.1%
Surprised 1.9%
Confused 1.7%
Disgusted 1.5%
Fear 0.7%

AWS Rekognition

Age 59-67
Gender Male, 100%
Calm 93.7%
Confused 2.6%
Sad 0.9%
Surprised 0.9%
Angry 0.8%
Disgusted 0.4%
Fear 0.4%
Happy 0.4%

AWS Rekognition

Age 48-56
Gender Male, 100%
Calm 71%
Confused 7.7%
Sad 5.7%
Angry 4.9%
Happy 3.7%
Surprised 2.7%
Disgusted 2.4%
Fear 1.9%

AWS Rekognition

Age 54-64
Gender Male, 100%
Calm 44.3%
Angry 41.2%
Confused 3.6%
Surprised 3.5%
Sad 3.3%
Fear 2%
Happy 1.2%
Disgusted 1%

AWS Rekognition

Age 50-58
Gender Male, 100%
Calm 78.3%
Angry 17.3%
Confused 2.5%
Surprised 0.4%
Disgusted 0.4%
Happy 0.4%
Sad 0.3%
Fear 0.3%

AWS Rekognition

Age 65-75
Gender Male, 100%
Calm 54.4%
Happy 26%
Fear 5.1%
Surprised 4%
Sad 3.1%
Confused 2.9%
Angry 2.5%
Disgusted 2.1%

AWS Rekognition

Age 63-73
Gender Male, 100%
Calm 98.8%
Sad 0.4%
Surprised 0.3%
Angry 0.2%
Happy 0.1%
Fear 0.1%
Confused 0.1%
Disgusted 0%

AWS Rekognition

Age 47-53
Gender Male, 100%
Calm 99.7%
Sad 0.1%
Surprised 0.1%
Angry 0%
Fear 0%
Confused 0%
Disgusted 0%
Happy 0%

Microsoft Cognitive Services

Age 67
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Suit 93.3%
Chair 87%

Captions

Microsoft

J. Howard Pew et al. posing for a photo 95.8%
J. Howard Pew et al. posing for the camera 95.7%
J. Howard Pew et al. posing for a picture 95.6%