Human Generated Data

Title

Untitled (group of men in suits seated in choir)

Date

1957

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2425

Human Generated Data

Title

Untitled (group of men in suits seated in choir)

People

Artist: Harry Annas, American 1897 - 1980

Date

1957

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-30

Accessory 99.6
Accessories 99.6
Tie 99.6
Person 99.4
Human 99.4
Tie 99.4
Person 98.8
Person 98.8
Person 98.4
Person 98.3
Person 98.3
Person 98.3
Jury 97.9
Room 97.7
Indoors 97.7
Person 96.6
Person 92.3
Court 81.7
Person 80.9
Person 80.1
Clothing 66.8
Suit 66.8
Coat 66.8
Overcoat 66.8
Apparel 66.8
Person 64.3
Person 57.2

Imagga
created on 2022-01-30

people 37.9
person 34
man 33
male 32.6
business 27.3
businessman 26.5
adult 26.3
room 26.1
women 26.1
smiling 26
office 26
group 25.8
happy 25.7
table 25.6
meeting 25.4
team 24.2
men 24
sitting 22.3
couple 20
work 19.6
executive 19.3
professional 19.2
businesswoman 19.1
corporate 18.9
indoors 18.4
together 18.4
worker 18.2
student 18.1
classroom 17.3
smile 17.1
businesspeople 17.1
teamwork 16.7
portrait 16.2
home 15.9
colleagues 15.5
cheerful 15.4
lifestyle 15.2
communication 15.1
job 15
happiness 14.9
modern 14.7
desk 14.7
two 14.4
teacher 13.7
love 13.4
family 13.3
talking 13.3
mature 13
new 13
suit 12.8
conference 12.7
interior 12.4
working 12.4
senior 12.2
education 12.1
life 11.9
confident 11.8
holding 11.6
nurse 11.3
presentation 11.2
marimba 11
successful 11
indoor 11
musical instrument 10.7
chair 10.4
looking 10.4
manager 10.2
clothing 10
30s 9.6
percussion instrument 9.6
outfit 9.5
school 9.1
success 8.8
staff 8.8
standing 8.7
window 8.6
collar 8.6
drinking 8.6
adults 8.5
friends 8.5
friendship 8.4
wine 8.3
laptop 8.2
baron 8
furniture 8
associates 7.9
coworkers 7.9
paper 7.8
casual clothing 7.8
teaching 7.8
color 7.8
cooperation 7.7
partner 7.7
leader 7.7
pretty 7.7
document 7.6
career 7.6
togetherness 7.6
groom 7.5
learning 7.5
enjoyment 7.5
study 7.5
company 7.4
hall 7.4
phone 7.4
employee 7.4
restaurant 7.3
handsome 7.1
romantic 7.1
enrollee 7.1
day 7.1
glass 7

Google
created on 2022-01-30

Black 89.6
Suit 81.3
Font 80.9
Rectangle 79.7
Monochrome photography 70.9
Monochrome 70.1
Event 68.8
Room 65.3
Stock photography 62.5
History 61.7

Microsoft
created on 2022-01-30

person 97.1
clothing 91.6
man 86.4
black 80.4
text 61.1
store 36.1

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Male, 100%
Calm 35.6%
Sad 22.2%
Angry 19.3%
Fear 8.3%
Surprised 4.2%
Confused 3.8%
Disgusted 3.5%
Happy 3.2%

AWS Rekognition

Age 54-62
Gender Male, 99.9%
Happy 52.7%
Calm 26.3%
Confused 10.8%
Surprised 3.1%
Sad 2.8%
Disgusted 2.7%
Angry 1%
Fear 0.7%

AWS Rekognition

Age 45-53
Gender Male, 99.6%
Calm 97.8%
Surprised 0.7%
Happy 0.6%
Sad 0.5%
Fear 0.2%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 54-62
Gender Male, 100%
Calm 41%
Happy 40.8%
Confused 6%
Disgusted 3.3%
Angry 3.2%
Surprised 3.2%
Sad 2.1%
Fear 0.5%

AWS Rekognition

Age 41-49
Gender Male, 99.7%
Calm 96.5%
Happy 2.5%
Sad 0.3%
Surprised 0.2%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 48-54
Gender Male, 99.8%
Sad 66.2%
Confused 20.9%
Calm 6.1%
Angry 4.2%
Surprised 0.8%
Happy 0.7%
Fear 0.6%
Disgusted 0.6%

AWS Rekognition

Age 13-21
Gender Male, 99.9%
Happy 30.8%
Surprised 18.3%
Calm 18%
Fear 10.5%
Angry 9.9%
Confused 7.3%
Sad 2.9%
Disgusted 2.3%

AWS Rekognition

Age 34-42
Gender Male, 100%
Calm 83.7%
Confused 11.3%
Disgusted 1.4%
Angry 1.2%
Happy 1%
Sad 0.9%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 48-56
Gender Male, 100%
Happy 59%
Calm 14.1%
Surprised 9.9%
Disgusted 5.3%
Angry 3.5%
Confused 3.3%
Sad 3.1%
Fear 1.8%

AWS Rekognition

Age 41-49
Gender Male, 99.9%
Sad 63.7%
Confused 17.2%
Calm 5%
Happy 4.9%
Angry 4.4%
Disgusted 2.2%
Fear 1.7%
Surprised 1%

AWS Rekognition

Age 21-29
Gender Male, 99.8%
Sad 86.6%
Calm 6%
Happy 4.1%
Confused 1.5%
Surprised 0.6%
Angry 0.6%
Fear 0.3%
Disgusted 0.3%

AWS Rekognition

Age 52-60
Gender Male, 99.8%
Calm 49%
Happy 11.5%
Confused 11.1%
Sad 10.4%
Fear 7.3%
Angry 5.3%
Surprised 3.1%
Disgusted 2.3%

AWS Rekognition

Age 24-34
Gender Female, 96.6%
Happy 94.7%
Sad 3.6%
Fear 0.6%
Calm 0.5%
Surprised 0.3%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 49-57
Gender Male, 100%
Calm 45.8%
Happy 12.5%
Angry 10.6%
Sad 9.2%
Disgusted 9.1%
Confused 8.3%
Surprised 3.2%
Fear 1.2%

AWS Rekognition

Age 29-39
Gender Male, 99.9%
Happy 73.1%
Sad 14.5%
Disgusted 6.1%
Confused 2.3%
Calm 1.7%
Angry 0.9%
Surprised 0.8%
Fear 0.5%

AWS Rekognition

Age 47-53
Gender Male, 90%
Calm 63.4%
Happy 28.5%
Sad 6.4%
Confused 0.6%
Fear 0.3%
Disgusted 0.3%
Angry 0.3%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.6%
Person 99.4%
Suit 66.8%

Captions

Microsoft

a group of people standing in front of a window 88.4%
a group of people standing in front of a store window 81.8%
a group of people standing in front of a store 81.7%

Text analysis

Amazon

ors

Google

MII7-YT37A°2 -XAGO
-XAGO
MII7-YT37A°2