Human Generated Data

Title

Untitled (group portrait of sixteen men in suits)
Date

c. 1970
People

Artist: Bachrach Studios, founded 1868
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.530

Human Generated Data

Title

Untitled (group portrait of sixteen men in suits)

People

Artist: Bachrach Studios, founded 1868

Date

c. 1970

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Tie 100
Accessories 100
Accessory 100
Tie 99.6
Jury 98.8
Person 98.8
Human 98.8
Person 98.5
Person 98.1
Person 97.9
Person 97.9
Person 97.9
Person 97.7
Person 97.7
Person 97.7
Person 97.4
Person 97.3
Person 97
Person 97
Person 96.5
Tie 95.8
Person 95.6
Person 94.3
Suit 90.7
Apparel 90.7
Coat 90.7
Overcoat 90.7
Clothing 90.7
Tie 86.4
Suit 86.2
Suit 86
Suit 84
Tie 83.7
Suit 82.7
Tie 81.3
Indoors 80
Room 78.7
Court 78.7
Crowd 76.9
Suit 76.2
Suit 75.5
Tie 72.9
People 61.7
Suit 59.6
Press Conference 56.9

Imagga
created on 2022-02-26

man 45
businessman 43.2
male 42.5
office 41.3
business 40.1
person 37.9
professional 35.7
team 34
group 33.8
people 33.5
meeting 33
executive 30
men 28.3
businesswoman 28.2
teamwork 27.8
happy 27.6
smiling 27.5
work 27.5
adult 27
corporate 26.6
table 24.5
teacher 23.9
sitting 23.2
women 22.9
student 22.6
colleagues 22.3
smile 22.1
suit 21.6
manager 21.4
job 21.2
successful 21
confident 20.9
businesspeople 20.9
laptop 19.1
success 18.5
communication 18.5
together 18.4
worker 18
desk 17.9
looking 17.6
staff 16.3
indoors 15.8
workplace 15.2
computer 14.4
talking 14.3
portrait 14.2
room 14.2
working 14.1
modern 14
education 13.9
coworkers 13.7
golfer 13.7
discussion 13.6
diversity 13.4
boss 13.4
presentation 13
hall 12.8
player 12.5
couple 12.2
senior 12.2
standing 12.2
company 12.1
mature 12.1
indoor 11.9
diverse 11.7
conference 11.7
businessmen 11.7
friendly 11
happiness 11
classroom 10.9
discussing 10.8
partners 10.7
30s 10.6
cheerful 10.6
secretary 10.4
educator 10.3
friends 10.3
director 10.3
black 10.2
school 10.1
center 10
holding 9.9
associates 9.8
mid adult 9.6
collar 9.6
adults 9.5
entrepreneur 9.5
lifestyle 9.4
judge 9.3
occupation 9.2
board 9
archive 9
employee 8.9
interaction 8.9
40s 8.8
workers 8.7
partnership 8.6
formal 8.6
learning 8.5
contestant 8.3
glasses 8.3
training 8.3
positive 8.3
20s 8.2
blackboard 8
interior 8
speaker 7.8
leader 7.7
confidence 7.7
casual 7.6
two 7.6
ethnic 7.6
finance 7.6
chair 7.6
showing 7.5
technology 7.4
enrollee 7.1

Google
created on 2022-02-26

Tie 91.2
Curtain 88.4
Suit 77.4
Official 75.6
Formal wear 74.2
Event 74.1
Blazer 72.5
Speaker 68
Varnish 66.9
Government 66.5
Flag 64.2
Team 62
White-collar worker 61.8
Collaboration 59.1
Tuxedo 56.9
Conference hall 56.6
Management 56.2
Metal 54.8
Public speaking 54.1
Meeting 53.6

Microsoft
created on 2022-02-26

person 99.6
suit 98.6
clothing 94.5
man 94.1
smile 85.1
human face 80.4
group 63.5
posing 46.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-44
Gender Male, 100%
Calm 77.3%
Happy 19.6%
Surprised 1.1%
Sad 0.6%
Confused 0.4%
Angry 0.4%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 53-61
Gender Male, 99.9%
Happy 89.4%
Calm 7.5%
Surprised 1.2%
Confused 0.6%
Angry 0.4%
Fear 0.3%
Sad 0.3%
Disgusted 0.2%

AWS Rekognition

Age 54-62
Gender Male, 100%
Calm 91%
Happy 5.8%
Sad 1%
Angry 0.8%
Confused 0.6%
Fear 0.3%
Surprised 0.3%
Disgusted 0.2%

AWS Rekognition

Age 54-62
Gender Male, 99.9%
Happy 98.4%
Angry 0.6%
Calm 0.2%
Surprised 0.2%
Confused 0.2%
Fear 0.2%
Disgusted 0.2%
Sad 0.1%

AWS Rekognition

Age 48-54
Gender Male, 99.8%
Angry 99.8%
Calm 0.1%
Sad 0%
Surprised 0%
Confused 0%
Fear 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 63-73
Gender Male, 100%
Happy 47.9%
Calm 39%
Angry 7.5%
Surprised 2.2%
Confused 1.4%
Sad 0.7%
Fear 0.6%
Disgusted 0.6%

AWS Rekognition

Age 58-66
Gender Male, 100%
Happy 97.6%
Calm 1.3%
Surprised 0.3%
Confused 0.2%
Disgusted 0.2%
Fear 0.1%
Angry 0.1%
Sad 0.1%

AWS Rekognition

Age 45-53
Gender Male, 100%
Calm 93%
Angry 2.3%
Sad 2.3%
Happy 0.8%
Disgusted 0.8%
Fear 0.4%
Surprised 0.3%
Confused 0.2%

AWS Rekognition

Age 58-66
Gender Male, 99.9%
Happy 99.7%
Angry 0.1%
Surprised 0%
Fear 0%
Sad 0%
Calm 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 48-54
Gender Male, 100%
Happy 56.7%
Calm 29.3%
Fear 3.4%
Surprised 2.9%
Angry 2.5%
Disgusted 2.4%
Confused 1.6%
Sad 1.2%

AWS Rekognition

Age 53-61
Gender Male, 99.7%
Happy 68.7%
Calm 13.6%
Confused 7.4%
Fear 2.8%
Sad 2.8%
Surprised 2.7%
Disgusted 1.1%
Angry 0.9%

AWS Rekognition

Age 66-76
Gender Male, 99.8%
Calm 90.4%
Happy 6.7%
Angry 0.6%
Confused 0.6%
Sad 0.6%
Surprised 0.5%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 61-71
Gender Male, 100%
Happy 81.1%
Calm 5.4%
Angry 4.8%
Sad 3.1%
Confused 1.7%
Surprised 1.5%
Fear 1.5%
Disgusted 1%

AWS Rekognition

Age 64-74
Gender Male, 100%
Calm 97.4%
Angry 1.4%
Surprised 0.5%
Sad 0.3%
Disgusted 0.1%
Fear 0.1%
Confused 0.1%
Happy 0%

AWS Rekognition

Age 53-61
Gender Male, 100%
Calm 73.5%
Angry 16%
Happy 3.8%
Surprised 1.9%
Sad 1.4%
Fear 1.3%
Confused 1.2%
Disgusted 0.9%

AWS Rekognition

Age 71-81
Gender Male, 100%
Calm 48.5%
Happy 42.5%
Angry 4.1%
Fear 2.2%
Surprised 1.5%
Sad 0.4%
Confused 0.4%
Disgusted 0.3%

Microsoft Cognitive Services

Age 61
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 100%
Person 98.8%
Suit 90.7%

Captions

Microsoft

a group of people posing for the camera 97.3%
a group of people posing for a photo 96.2%
a group of people posing for a picture 96.1%