Human Generated Data

Title

Untitled (men in lunch line)

Date

1946, printed later

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.190

Human Generated Data

Title

Untitled (men in lunch line)

People

Artist: Jack Gould, American

Date

1946, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 98.9
Person 98.9
Person 98.8
Person 98.5
Accessories 98.4
Tie 98.4
Accessory 98.4
Person 98.2
Person 98
Food 97.7
Meal 97.7
Person 97.5
Person 97.5
Apparel 97.2
Clothing 97.2
Dish 83.5
Suit 82.9
Coat 82.9
Overcoat 82.9
Restaurant 81.7
Person 75.7
Hat 75.5
Cafeteria 72.7
Tie 71.1
Hat 70.7
People 63.3
Person 62.3
Crowd 59
Suit 51.8

Imagga
created on 2021-12-14

waiter 43.8
man 41
male 36.2
business 35.8
employee 34.1
people 33.5
adult 31.4
dining-room attendant 31.2
meeting 30.2
office 29.4
businessman 28.3
person 28.2
worker 27.4
businesswoman 27.3
happy 26.3
businesspeople 25.6
corporate 24.1
men 24
group 23.4
restaurant 23.2
team 22.4
colleagues 22.3
work 22
table 21.6
working 21.2
20s 20.2
couple 20
smiling 19.5
lifestyle 19.5
executive 19.5
job 19.5
laptop 19.3
professional 18.6
teamwork 18.5
smile 18.5
together 18.4
women 17.4
talking 17.1
holding 16.5
sitting 16.3
success 16.1
busy 15.4
attractive 15.4
suit 15.3
computer 15.3
indoors 14.9
30s 14.4
communication 14.3
handsome 14.3
drink 14.2
indoor 13.7
formal 13.4
day 13.3
desk 13.2
coffee 13
portrait 12.9
casual 12.7
adults 12.3
clothing 11.7
corporation 11.6
mid adult 11.6
career 11.4
successful 11
eating 10.9
confident 10.9
associates 10.8
coworkers 10.8
conference 10.8
businessmen 10.7
building 10.7
meal 10.6
staff 10.6
cheerful 10.6
standing 10.4
home 10.4
manager 10.2
mature 10.2
food 10.2
occupation 10.1
horizontal 10
color 10
discussion 9.7
having 9.7
females 9.5
happiness 9.4
senior 9.4
dinner 9.3
wine 9.3
pretty 9.1
discussing 8.8
businesswomen 8.8
25 30 years 8.8
looking 8.8
partners 8.7
four 8.6
boss 8.6
workplace 8.6
friends 8.5
modern 8.4
presentation 8.4
service 8.3
beverage 8.2
kitchen 8.1
family 8
face 7.8
good looking 7.8
room 7.7
two 7.6
finance 7.6
camera 7.4
love 7.1
glass 7

Google
created on 2021-12-14

Food 97.8
Tableware 95.3
Photograph 94.3
White 92.2
Coat 91.8
Hat 90.9
Plate 85.6
Fedora 85.3
Suit 82.3
Serveware 79.5
Sun hat 79.3
Cuisine 79.2
Snapshot 74.3
Dishware 72.9
Event 72.6
Dessert 71.9
Saucer 71.6
Cooking 69.6
Cake 68.5
Monochrome photography 67.6

Microsoft
created on 2021-12-14

clothing 97.5
person 96.9
man 95.5
text 91.8
food 87.4
black and white 68.9
fast food 64.8
crowd 1.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 31-47
Gender Male, 94.4%
Calm 98.2%
Happy 0.7%
Surprised 0.4%
Sad 0.3%
Angry 0.2%
Fear 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 39-57
Gender Male, 91.3%
Calm 96.4%
Surprised 1.2%
Angry 0.9%
Sad 0.5%
Happy 0.5%
Fear 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 32-48
Gender Male, 96.8%
Calm 90.5%
Sad 4.4%
Angry 2.7%
Surprised 1.2%
Confused 0.5%
Happy 0.4%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 26-40
Gender Male, 92.6%
Calm 82%
Sad 7.9%
Confused 4.7%
Angry 2.5%
Fear 1.3%
Disgusted 0.8%
Surprised 0.8%
Happy 0.2%

AWS Rekognition

Age 42-60
Gender Male, 98.6%
Calm 83.5%
Angry 8%
Sad 3.6%
Confused 2.5%
Happy 0.8%
Surprised 0.8%
Fear 0.6%
Disgusted 0.3%

AWS Rekognition

Age 22-34
Gender Male, 98.4%
Calm 70.5%
Confused 19.3%
Sad 5.9%
Angry 1.6%
Surprised 1.3%
Fear 0.6%
Disgusted 0.5%
Happy 0.4%

AWS Rekognition

Age 41-59
Gender Male, 66.2%
Angry 48.7%
Calm 17.6%
Happy 15.2%
Sad 10.3%
Fear 3.9%
Disgusted 1.9%
Confused 1.9%
Surprised 0.5%

AWS Rekognition

Age 39-57
Gender Male, 88.5%
Calm 93.2%
Sad 2.3%
Happy 1.7%
Surprised 0.9%
Angry 0.9%
Confused 0.5%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 30-46
Gender Male, 95.2%
Happy 97.5%
Calm 1.6%
Surprised 0.5%
Sad 0.1%
Confused 0.1%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 22-34
Gender Male, 99.4%
Sad 51.5%
Calm 31.3%
Happy 10.4%
Confused 2.6%
Fear 1.8%
Angry 1.7%
Surprised 0.5%
Disgusted 0.2%

AWS Rekognition

Age 31-47
Gender Male, 69%
Sad 37.2%
Calm 20.9%
Fear 16.8%
Happy 15.2%
Surprised 5.4%
Confused 2.4%
Angry 1.2%
Disgusted 0.8%

AWS Rekognition

Age 40-58
Gender Male, 89.3%
Calm 55.4%
Sad 14%
Surprised 12.3%
Happy 11.2%
Disgusted 3.5%
Confused 1.6%
Fear 1.4%
Angry 0.7%

AWS Rekognition

Age 39-57
Gender Female, 51.2%
Calm 54.8%
Sad 32.3%
Happy 5.3%
Angry 4.3%
Confused 1.6%
Disgusted 0.7%
Fear 0.6%
Surprised 0.4%

AWS Rekognition

Age 34-50
Gender Female, 57.7%
Sad 96.5%
Calm 2.9%
Fear 0.2%
Happy 0.2%
Angry 0.1%
Confused 0.1%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 39-57
Gender Female, 72%
Calm 45.6%
Sad 33.3%
Confused 5.9%
Angry 3.7%
Happy 3.5%
Fear 3.3%
Surprised 2.7%
Disgusted 1.9%

AWS Rekognition

Age 29-45
Gender Male, 63.1%
Sad 84.6%
Calm 13.7%
Confused 0.5%
Fear 0.4%
Angry 0.3%
Happy 0.3%
Disgusted 0.1%
Surprised 0.1%

Microsoft Cognitive Services

Age 65
Gender Male

Microsoft Cognitive Services

Age 43
Gender Male

Microsoft Cognitive Services

Age 68
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Tie 98.4%
Suit 82.9%
Hat 75.5%

Captions

Microsoft

a group of people standing around a table 97.1%
a group of people sitting at a table 95.2%
a group of people standing in front of a window 94%