Human Generated Data

Title

Untitled (long line of people waiting to order in restaurant)

Date

1946

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14546

Human Generated Data

Title

Untitled (long line of people waiting to order in restaurant)

People

Artist: Jack Gould, American

Date

1946

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Human 99.8
Person 99.8
Restaurant 99.6
Person 98.9
Person 98.7
Person 98.6
Person 97.9
Person 97.2
Person 97.1
Person 96
Person 94.4
Person 94
Food 93.1
Meal 93.1
Person 92.5
Person 91.8
Cafe 89.3
Cafeteria 88
Food Court 83.2
Person 82.4
Dish 70.4
Person 69.9
Furniture 69.2
Chair 69.2
Person 67.1
Person 64.1
Person 63.5
Sitting 60.3
Dining Table 59.9
Table 59.9
Person 44.4

Imagga
created on 2022-01-29

barbershop 67.5
shop 52
mercantile establishment 41.2
man 36.3
people 35.1
male 32.6
person 31.3
adult 28.2
place of business 27.7
room 25.5
home 23.1
women 22.9
indoors 22.8
couple 22.6
businessman 22.1
office 21.8
group 21.7
men 21.5
smiling 19.5
business 19.4
happy 19.4
sitting 18
indoor 17.3
computer 16
table 15.6
teacher 15.2
desk 15.1
senior 15
together 14.9
mature 14.9
laptop 14.8
portrait 14.2
establishment 13.9
education 13.8
professional 13.8
classroom 13.4
family 13.3
modern 13.3
happiness 13.3
meeting 13.2
worker 13.1
smile 12.8
businesswoman 12.7
colleagues 12.6
team 12.5
talking 12.3
businesspeople 12.3
corporate 12
work 11.8
cheerful 11.4
chair 11.3
teamwork 11.1
inside 11
lifestyle 10.8
clothing 10.8
handsome 10.7
job 10.6
interior 10.6
30s 10.6
patient 10.5
nurse 10.2
horizontal 10
mother 10
class 9.6
student 9.6
adults 9.5
casual 9.3
two 9.3
communication 9.2
20s 9.2
color 8.9
executive 8.5
hospital 8.5
enjoying 8.5
face 8.5
study 8.4
manager 8.4
old 8.4
occupation 8.2
board 8.1
suit 8.1
to 8
working 7.9
medical 7.9
casual clothing 7.8
life 7.8
40s 7.8
mid adult 7.7
elderly 7.7
friends 7.5
learning 7.5
human 7.5
camera 7.4
kin 7.4
back 7.3
new 7.3
blackboard 7.3
dress 7.2
looking 7.2
love 7.1
day 7.1

Google
created on 2022-01-29

Chair 88.4
Art 79.6
Adaptation 79.2
Motor vehicle 74.6
Event 71.9
Room 71.6
Suit 69.6
Vintage clothing 68.3
Monochrome 67.5
Font 67.2
Service 65.9
History 65.4
Table 64.2
Monochrome photography 63.7
Illustration 62.9
Stock photography 62.8
Team 59.1
Job 57.7
Visual arts 57.3
Class 57

Microsoft
created on 2022-01-29

text 98.7
person 96.6
clothing 94.2
woman 75.2
man 69.3
group 65
people 56.8
clothes 19.1

Face analysis

Amazon

Google

AWS Rekognition

Age 51-59
Gender Female, 99.5%
Calm 94.8%
Surprised 3.8%
Sad 0.7%
Fear 0.2%
Disgusted 0.2%
Angry 0.1%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 36-44
Gender Female, 65.6%
Sad 38.3%
Calm 35%
Happy 9.4%
Surprised 8.8%
Confused 3.6%
Disgusted 2.6%
Angry 1.3%
Fear 0.9%

AWS Rekognition

Age 28-38
Gender Male, 99.5%
Calm 94.3%
Sad 2.3%
Surprised 1.5%
Angry 0.8%
Disgusted 0.3%
Happy 0.3%
Confused 0.3%
Fear 0.1%

AWS Rekognition

Age 33-41
Gender Male, 99.5%
Calm 65.9%
Sad 12.8%
Disgusted 7.3%
Happy 4.4%
Surprised 4%
Confused 3.7%
Fear 1.2%
Angry 0.7%

AWS Rekognition

Age 28-38
Gender Male, 99.7%
Calm 56%
Sad 22%
Surprised 8.6%
Happy 4.6%
Fear 3.7%
Disgusted 2.4%
Angry 1.6%
Confused 1.2%

AWS Rekognition

Age 49-57
Gender Male, 97.8%
Sad 42.5%
Calm 37.3%
Happy 5.1%
Surprised 4.9%
Confused 4.9%
Disgusted 1.9%
Angry 1.8%
Fear 1.7%

AWS Rekognition

Age 31-41
Gender Male, 97.8%
Calm 96.7%
Happy 1.2%
Sad 0.8%
Surprised 0.6%
Disgusted 0.3%
Fear 0.2%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 20-28
Gender Female, 61.7%
Calm 91.2%
Sad 6.4%
Surprised 1%
Confused 0.6%
Disgusted 0.3%
Angry 0.3%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 47-53
Gender Female, 72.6%
Sad 52.6%
Calm 24.5%
Confused 9.3%
Happy 8.8%
Surprised 1.7%
Disgusted 1.3%
Angry 1.1%
Fear 0.6%

AWS Rekognition

Age 28-38
Gender Female, 51.7%
Calm 68.3%
Happy 17.3%
Confused 4%
Sad 3.6%
Surprised 2.4%
Angry 2.2%
Fear 1.1%
Disgusted 1.1%

AWS Rekognition

Age 23-33
Gender Female, 74%
Calm 89%
Sad 3%
Angry 2.2%
Surprised 1.9%
Confused 1.6%
Fear 1.4%
Disgusted 0.6%
Happy 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Chair 69.2%

Captions

Microsoft

a group of people standing in front of a crowd 73.4%
a group of people in a room 73.3%
a group of people sitting in front of a crowd 68.2%