Human Generated Data

Title

Untitled (women standing in lunch line)
Date

1946, printed later
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.165

Human Generated Data

Title

Untitled (women standing in lunch line)

People

Artist: Jack Gould, American

Date

1946, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 99.8
Person 99.8
Person 99.3
Person 99.2
Person 98.5
Person 98.5
Person 98.1
Person 98
Person 97.5
Restaurant 96.2
Person 94.9
Person 94.4
Person 94.3
Person 94.2
Person 91.4
Person 90.7
Clothing 89.1
Apparel 89.1
Hat 89.1
Person 84.3
Indoors 84.2
Room 84.2
Cafeteria 83.7
Crowd 80.2
Person 76.8
Meal 76.1
Food 76.1
Sitting 75.9
Furniture 73.2
Classroom 70.3
School 70.3
Person 65.8
Dish 65
Food Court 64.2
Table 62.4
Workshop 59.4
People 58.9
Audience 57.1
Waiting Room 55.5
Reception Room 55.5
Reception 55.5
Cafe 55.2

Imagga
created on 2021-12-14

man 39.6
office 38.7
computer 36.8
people 35.7
business 35.2
person 33.6
laptop 32
professional 31.9
businessman 31.8
male 30.5
meeting 29.2
working 29.2
adult 29
corporate 28.3
work 28.3
group 28.2
team 26
room 25.9
businesswoman 23.6
teacher 23.6
table 22.8
sitting 22.3
teamwork 22.2
indoors 22
happy 21.9
men 21.5
smiling 21
executive 20.4
desk 20.2
communication 20.2
home 19.9
classroom 19.5
job 18.6
businesspeople 18
worker 17.4
technology 17.1
together 16.6
student 16.6
education 16.5
talking 16.2
women 15
indoor 14.6
confident 14.6
couple 13.9
cheerful 13.8
successful 13.7
partners 13.6
looking 13.6
corporation 13.5
handsome 13.4
workplace 13.3
lifestyle 13
center 13
smile 12.8
colleagues 12.6
interior 12.4
employee 12.2
occupation 11.9
two 11.9
house 11.7
suit 11.7
notebook 11.6
monitor 11.5
educator 11.5
career 11.4
contemporary 11.3
learning 11.3
success 11.3
keyboard 11.3
showing 11.3
modern 11.2
attractive 11.2
conference 10.7
presentation 10.2
businessmen 9.8
cooperation 9.7
couch 9.7
collar 9.6
happiness 9.4
expression 9.4
manager 9.3
horizontal 9.2
20s 9.2
chair 8.9
collaboration 8.9
studying 8.6
gesture 8.6
college 8.5
casual 8.5
company 8.4
mature 8.4
camera 8.3
school 8.1
associate 7.9
associates 7.9
restaurant 7.9
discussion 7.8
staff 7.8
portrait 7.8
class 7.7
pretty 7.7
sofa 7.7
adults 7.6
females 7.6
pen 7.5
friends 7.5
study 7.5
document 7.4
specialist 7.3
equipment 7.2
to 7.1

Google
created on 2021-12-14

Chair 86.7
Coat 85.6
Suit 78
Table 77.2
Event 73.8
Monochrome photography 71.2
Monochrome 69.2
Room 68.9
Vintage clothing 68.5
Recreation 66.6
Classic 66.4
History 64.2
Stock photography 63.4
Font 63
Photo caption 61.4
Sitting 59.2
Team 58.7
Desk 51.7
Photographic paper 50.4

Microsoft
created on 2021-12-14

person 98.8
text 98
clothing 97.1
man 92
people 76.2
group 73.8
table 71.3
posing 60.3
human face 54
woman 53.7
clothes 32.1
several 10.2

Face analysis

Amazon

Google

AWS Rekognition

Age 20-32
Gender Female, 97.2%
Calm 37%
Sad 26.9%
Happy 17.3%
Fear 5.5%
Angry 4.6%
Disgusted 3.2%
Confused 3%
Surprised 2.6%

AWS Rekognition

Age 22-34
Gender Female, 98.2%
Calm 95.3%
Sad 1.8%
Angry 0.8%
Surprised 0.7%
Happy 0.4%
Confused 0.4%
Fear 0.3%
Disgusted 0.2%

AWS Rekognition

Age 23-35
Gender Female, 64.7%
Calm 89.2%
Sad 3.6%
Surprised 2.3%
Fear 1.8%
Angry 1.4%
Confused 0.9%
Happy 0.5%
Disgusted 0.2%

AWS Rekognition

Age 17-29
Gender Female, 93%
Calm 45.6%
Surprised 41.3%
Fear 5.6%
Angry 4.3%
Sad 1%
Confused 0.8%
Disgusted 0.7%
Happy 0.7%

AWS Rekognition

Age 18-30
Gender Female, 97.5%
Calm 90.6%
Sad 2%
Disgusted 2%
Surprised 1.7%
Angry 1.4%
Confused 1%
Happy 0.8%
Fear 0.6%

AWS Rekognition

Age 22-34
Gender Male, 78.5%
Calm 92.3%
Surprised 4.8%
Fear 1%
Angry 0.7%
Sad 0.5%
Confused 0.3%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 31-47
Gender Female, 98.5%
Happy 99.3%
Angry 0.3%
Surprised 0.1%
Fear 0.1%
Calm 0%
Sad 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 21-33
Gender Female, 87.3%
Happy 96.9%
Surprised 2.4%
Angry 0.2%
Fear 0.1%
Confused 0.1%
Calm 0.1%
Sad 0.1%
Disgusted 0.1%

AWS Rekognition

Age 23-35
Gender Female, 99.4%
Happy 31.7%
Calm 30.5%
Disgusted 25.6%
Surprised 3.8%
Angry 3.1%
Confused 2.6%
Sad 1.5%
Fear 1.2%

AWS Rekognition

Age 22-34
Gender Male, 72.4%
Calm 80.2%
Sad 17.4%
Confused 1.5%
Angry 0.4%
Surprised 0.2%
Fear 0.1%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 27-43
Gender Female, 60.1%
Sad 58%
Calm 28.8%
Happy 4.5%
Confused 2.8%
Angry 2.8%
Disgusted 1.4%
Fear 1.2%
Surprised 0.5%

AWS Rekognition

Age 12-22
Gender Female, 76.9%
Sad 71.9%
Calm 26.9%
Confused 0.4%
Angry 0.3%
Fear 0.2%
Happy 0.2%
Surprised 0.1%
Disgusted 0%

AWS Rekognition

Age 21-33
Gender Male, 99.5%
Angry 27.7%
Calm 23.1%
Fear 18.8%
Sad 16.3%
Surprised 5.9%
Happy 3.9%
Disgusted 3.2%
Confused 1.1%

AWS Rekognition

Age 13-23
Gender Female, 95.9%
Sad 84.1%
Angry 5.3%
Fear 5.2%
Calm 3.2%
Confused 0.9%
Surprised 0.5%
Happy 0.5%
Disgusted 0.3%

AWS Rekognition

Age 23-35
Gender Female, 79.7%
Calm 77%
Surprised 8.3%
Sad 7.3%
Happy 2.2%
Confused 1.9%
Fear 1.7%
Angry 1%
Disgusted 0.5%

AWS Rekognition

Age 20-32
Gender Female, 62.5%
Calm 79.2%
Sad 6.7%
Disgusted 6%
Happy 3.7%
Angry 2.3%
Surprised 0.8%
Confused 0.7%
Fear 0.5%

AWS Rekognition

Age 25-39
Gender Male, 72.3%
Calm 55.9%
Fear 16%
Happy 9.2%
Angry 6.6%
Surprised 5.2%
Sad 3.9%
Disgusted 2.1%
Confused 1.2%

AWS Rekognition

Age 38-56
Gender Female, 59.7%
Sad 43.6%
Happy 29%
Calm 16.8%
Fear 4.4%
Angry 2.6%
Surprised 1.8%
Confused 1.3%
Disgusted 0.5%

AWS Rekognition

Age 26-42
Gender Female, 62.5%
Calm 77.9%
Sad 13.3%
Angry 1.8%
Happy 1.8%
Confused 1.7%
Fear 1.3%
Surprised 1.1%
Disgusted 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Hat 89.1%

Captions

Microsoft

a group of people posing for a photo 93.8%
a group of people posing for the camera 93.7%
a group of people posing for a picture 93.6%