Human Generated Data

Title

Untitled (three men with film projector)

Date

1951

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20147

Human Generated Data

Title

Untitled (three men with film projector)

People

Artist: Peter James Studio, American

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Tie 99.7
Accessories 99.7
Accessory 99.7
Furniture 99.7
Person 98.8
Human 98.8
Person 97.3
Apparel 96.9
Clothing 96.9
Person 96
Chair 95.6
Sitting 95.4
Tie 84.4
Overcoat 68.8
Suit 68.8
Coat 68.8
Person 68.4
Clinic 63
Photography 61.3
Photo 61.3
Shorts 57.8
Text 56.9

Imagga
created on 2022-03-05

businessman 59.2
business 50.4
man 47
male 43.3
office 42.6
corporate 38.7
person 36.8
wind instrument 35.7
meeting 34.9
brass 34.8
people 34.6
executive 34.3
professional 32.8
businesswoman 30.9
team 30.5
businesspeople 30.4
group 29.8
adult 29.5
men 27.5
work 25.1
job 24.8
laptop 24.6
worker 23.3
teamwork 23.2
cornet 23
suit 22.8
musical instrument 22.4
happy 21.3
room 20.9
desk 20.8
manager 20.5
colleagues 20.4
computer 20.1
table 19
conference 18.6
successful 18.3
confident 18.2
handsome 17.8
indoor 17.3
sax 17.3
sitting 17.2
success 16.9
modern 16.8
communication 16.8
smiling 16.6
looking 16
boss 15.3
talking 15.2
discussion 14.6
smile 14.3
presentation 14
employee 13.7
corporation 13.5
women 13.4
working 13.3
career 13.2
indoors 13.2
couple 13.1
company 13
associates 12.8
casual 12.7
together 12.3
coworkers 11.8
entrepreneur 11.8
tie 11.4
education 11.3
two 11
finance 11
teacher 10.9
collaboration 10.8
businessmen 10.7
cooperation 10.6
leader 10.6
cheerful 10.6
collar 10.5
workplace 10.5
ethnic 10.5
portrait 10.4
color 10
idea 9.8
new 9.7
horn 9.7
staff 9.7
formal 9.6
serious 9.5
adults 9.5
happiness 9.4
hall 9.4
face 9.2
horizontal 9.2
life 9.2
20s 9.2
planner 8.9
discussing 8.8
conversation 8.7
employment 8.7
partner 8.7
mid adult 8.7
30s 8.7
diversity 8.6
partnership 8.6
paper 8.6
device 8.5
hand 8.4
oboe 8.2
lifestyle 8
seminar 7.9
25 30 years 7.8
standing 7.8
colleague 7.8
black 7.8
busy 7.7
attractive 7.7
human 7.5
ideas 7.5
technology 7.4
camera 7.4
board 7.2

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

text 98.4
person 97.3
clothing 94.9
outdoor 92.3
man 87.5
player 62.3
furniture 54.3
black and white 50.1
old 46.9

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Male, 100%
Surprised 49.4%
Calm 28.4%
Happy 6.7%
Disgusted 4.6%
Sad 3.8%
Angry 3.3%
Confused 2.5%
Fear 1.4%

AWS Rekognition

Age 45-53
Gender Male, 100%
Surprised 52.6%
Calm 18%
Disgusted 9.7%
Confused 9.4%
Happy 7.5%
Fear 1.3%
Angry 0.9%
Sad 0.5%

AWS Rekognition

Age 50-58
Gender Male, 99.9%
Calm 99.8%
Surprised 0.1%
Confused 0%
Disgusted 0%
Happy 0%
Sad 0%
Angry 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.7%
Person 98.8%
Chair 95.6%

Captions

Microsoft

a group of people posing for a photo 79.3%
a group of people posing for the camera 79.2%
a group of people posing for a picture 79.1%

Text analysis

Amazon

J8
KODVK-SEIA

Google

YT37A2-XA
YT37A2-XA