Human Generated Data

Title

Untitled (large group of men, seen from above)

Date

1951

People

Artist: Lester Cole, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19641

Human Generated Data

Title

Untitled (large group of men, seen from above)

People

Artist: Lester Cole, American

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.6
Apparel 99.6
Person 99.6
Human 99.6
Person 99.4
Person 99
Person 98.7
Person 97
Person 96.8
Person 96.2
Person 95.9
Person 94.4
Accessories 93.6
Tie 93.6
Accessory 93.6
Person 93.2
Face 90.7
Person 88.9
Tie 85.1
Fashion 83.9
Robe 83.9
Indoors 82.1
Meal 81.3
Food 81.3
Gown 79.9
Wedding 77.6
People 73
Person 72.7
Room 72.4
Wedding Gown 69.1
Crowd 66.8
Suit 66
Overcoat 66
Coat 66
Portrait 65.5
Photography 65.5
Photo 65.5
Person 61.5
Female 59.6
Dress 59.6
Shirt 59.2
Dish 59.1
Bridegroom 57.5
Floor 56.6
Bride 56.6
Furniture 55.4
Table 55.4
Person 48.2
Person 46
Person 43.3

Imagga
created on 2022-03-05

nurse 64.5
man 40.3
person 38.6
people 32.9
male 29
businessman 27.3
business 24.3
team 24.2
professional 23.9
doctor 22.5
happy 22.5
medical 22
group 21.7
brass 21.5
job 21.2
adult 20.4
specialist 20.2
student 20.1
men 18.9
work 18.8
hospital 18.8
patient 18.5
surgeon 18.3
medicine 16.7
occupation 16.5
health 16
case 15.8
wind instrument 15.6
teacher 14.9
smiling 14.4
worker 14.3
uniform 14.2
portrait 14.2
standing 13.9
staff 13.5
teamwork 13
success 12.9
stethoscope 12.5
couple 12.2
human 12
fan 11.8
coat 11.8
care 11.5
player 11.3
looking 11.2
camera 11.1
casual 11
confident 10.9
businesswoman 10.9
golfer 10.8
clinic 10.8
musical instrument 10.7
stage 10.6
room 10.5
office 10.4
corporate 10.3
company 10.2
black 10.2
happiness 10.2
smile 10
handsome 9.8
trombone 9.8
colleagues 9.7
hands 9.5
illness 9.5
women 9.5
meeting 9.4
senior 9.4
lab coat 8.9
cheerful 8.9
doctors 8.8
education 8.6
30s 8.6
diversity 8.6
profession 8.6
chart 8.6
businesspeople 8.5
two 8.5
mature 8.4
practitioner 8.3
positive 8.3
20s 8.2
blackboard 8
follower 8
working 7.9
boy 7.8
clinical 7.8
play 7.7
old 7.7
cornet 7.7
elderly 7.6
hand 7.6
career 7.6
joy 7.5
fun 7.5
successful 7.3
sick person 7.3
idea 7.1

Google
created on 2022-03-05

Photograph 94.2
Black-and-white 85.5
Style 84
Line 81.9
Headgear 81.7
Font 81.4
Suit 79.9
Adaptation 79.2
Crowd 78.8
Art 77
Monochrome photography 76.6
Monochrome 76.5
Hat 75.8
T-shirt 73.7
Event 73.1
Room 68.5
Uniform 67.4
Illustration 66.4
Crew 66
Photo caption 65.4

Microsoft
created on 2022-03-05

person 99.2
man 91.6
clothing 87.9
text 81.1
people 66.8
group 55.8
crowd 35.7

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Male, 93.3%
Calm 76.1%
Sad 17.7%
Happy 2.3%
Angry 1.6%
Confused 1.1%
Fear 0.5%
Surprised 0.4%
Disgusted 0.3%

AWS Rekognition

Age 47-53
Gender Male, 99.5%
Calm 59.5%
Sad 26.5%
Happy 4.4%
Confused 3.9%
Disgusted 2.7%
Angry 2.1%
Fear 0.4%
Surprised 0.4%

AWS Rekognition

Age 54-64
Gender Male, 62.2%
Calm 98.4%
Sad 0.9%
Surprised 0.3%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Happy 0%
Fear 0%

AWS Rekognition

Age 37-45
Gender Male, 94.9%
Sad 59%
Calm 28.5%
Confused 7.6%
Happy 3.5%
Disgusted 0.5%
Angry 0.4%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 26-36
Gender Male, 93.6%
Happy 53.7%
Sad 19.2%
Calm 15.4%
Confused 3.5%
Angry 3.3%
Disgusted 2.2%
Surprised 1.8%
Fear 0.8%

AWS Rekognition

Age 42-50
Gender Male, 99.7%
Calm 72%
Sad 13.9%
Happy 8.1%
Confused 1.9%
Angry 1.7%
Disgusted 1.4%
Surprised 0.7%
Fear 0.4%

AWS Rekognition

Age 29-39
Gender Male, 96.4%
Calm 99.5%
Confused 0.2%
Sad 0.1%
Angry 0%
Happy 0%
Surprised 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 47-53
Gender Male, 99.4%
Calm 91.4%
Angry 2.7%
Sad 1.4%
Happy 1.3%
Confused 1.3%
Surprised 1.1%
Disgusted 0.6%
Fear 0.1%

AWS Rekognition

Age 48-56
Gender Male, 69.3%
Sad 39%
Confused 31.8%
Calm 19.4%
Surprised 5.3%
Disgusted 1.4%
Fear 1.2%
Happy 1.1%
Angry 0.7%

AWS Rekognition

Age 40-48
Gender Female, 96.2%
Calm 98.8%
Happy 0.4%
Sad 0.3%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 24-34
Gender Female, 54.5%
Calm 99.4%
Sad 0.3%
Confused 0.1%
Angry 0%
Happy 0%
Disgusted 0%
Fear 0%
Surprised 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.6%
Tie 93.6%

Captions

Microsoft

a group of people standing in front of a crowd 92.4%
a group of people standing in front of a crowd posing for the camera 89.5%
a group of people posing for a photo in front of a crowd 89.4%

Text analysis

Amazon

28
e8

Google

e8
e8