Human Generated Data

Title

Untitled (teenagers at soda fountain)
Date

1952, printed later
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.226

Human Generated Data

Title

Untitled (teenagers at soda fountain)

People

Artist: Harry Annas, American 1897 - 1980

Date

1952, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.7
Human 99.7
Person 99.7
Person 99.5
Person 99.3
Person 97.3
Sitting 97.1
Meal 89.6
Food 89.6
Couch 81.1
Furniture 81.1
Cafeteria 65.5
Restaurant 65.5
Worker 64.8
People 57.2

Imagga
created on 2022-01-23

office 43.7
man 41.7
business 39.5
people 37.9
businessman 37.1
meeting 35.8
male 35.5
person 35.3
professional 33.4
working 31.8
businesswoman 30.9
table 29.3
computer 28.7
desk 28.7
adult 28.5
businesspeople 28.5
work 28.3
team 27.8
corporate 27.5
executive 27.4
group 26.6
sitting 24.9
teamwork 24.1
worker 22.8
happy 22.6
laptop 21.5
job 21.2
room 21.1
smiling 19.5
indoors 19.3
communication 19.3
teacher 18.4
colleagues 17.5
specialist 17.4
men 17.2
workplace 17.2
talking 17.1
manager 16.8
together 16.7
successful 16.5
indoor 16.4
confident 16.4
women 15.8
smile 15
classroom 14.9
modern 14.7
monitor 13.9
partners 13.6
looking 13.6
education 13
home 12.8
technology 12.6
center 12.3
career 12.3
presentation 12.1
casual 11.9
associates 11.8
colleague 11.7
nurse 11.7
discussion 11.7
lifestyle 11.6
collar 11.5
expression 11.1
conference 10.8
employee 10.5
boss 10.5
success 10.5
portrait 10.4
showing 10.3
company 10.2
document 10.2
happiness 10.2
two 10.2
patient 9.9
seminar 9.8
coworkers 9.8
handsome 9.8
clothing 9.8
cheerful 9.8
interior 9.7
corporation 9.6
student 9.6
staff 9.6
adults 9.5
entrepreneur 9.4
mature 9.3
occupation 9.2
hand 9.1
suit 9.1
attractive 9.1
board 9
collaboration 8.9
40s 8.8
cooperation 8.7
leader 8.7
paper 8.6
pen 8.5
keyboard 8.4
training 8.3
20s 8.2
to 8
couple 7.8
equipment 7.8
class 7.7
busy 7.7
screen 7.7
30s 7.7
project 7.7
shop 7.6
barbershop 7.3

Google
created on 2022-01-23

Shirt 94.5
Table 91.7
Black 89.6
Chair 85.6
Black-and-white 84.6
Tableware 80.6
Monochrome 74.6
Monochrome photography 74.1
Event 72.1
Recreation 70.5
Room 70
Vintage clothing 69.2
Font 66.2
Sitting 66
Conversation 65.7
Stock photography 65.1
Games 63.8
T-shirt 57.6
History 53.4
Team 53.4

Microsoft
created on 2022-01-23

text 99.1
person 98.8
indoor 95.9
clothing 93.7
man 86.3
table 85.3
smile 81.3
human face 78.4
black and white 74.4
posing 59.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-26
Gender Male, 99.9%
Calm 75%
Happy 16%
Surprised 3.3%
Confused 1.8%
Angry 1.7%
Fear 1.2%
Sad 0.5%
Disgusted 0.5%

AWS Rekognition

Age 14-22
Gender Male, 100%
Calm 98.5%
Happy 1.4%
Surprised 0.1%
Confused 0%
Sad 0%
Fear 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Female, 100%
Happy 95.5%
Surprised 2.9%
Fear 0.9%
Angry 0.2%
Disgusted 0.2%
Confused 0.2%
Calm 0.1%
Sad 0%

AWS Rekognition

Age 18-24
Gender Female, 97.6%
Happy 98.6%
Surprised 0.6%
Calm 0.2%
Angry 0.2%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%
Sad 0.1%

AWS Rekognition

Age 13-21
Gender Female, 100%
Happy 99%
Calm 0.5%
Surprised 0.2%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Sad 0%
Fear 0%

AWS Rekognition

Age 16-22
Gender Female, 99.8%
Happy 54.7%
Disgusted 13%
Angry 11.7%
Calm 10.7%
Confused 3.5%
Surprised 2.9%
Fear 2.3%
Sad 1.3%

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 23
Gender Male

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 37
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people posing for a photo 89.1%
a group of people posing for the camera 89%
a group of people posing for a picture 88.9%

Text analysis

Amazon

JO
2 JO
2
8
Y
B
0