Human Generated Data

Title

Aaron Siskind

Date

c. 1930

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Carl Chiarenza and Heidi Katz, P1999.46

Human Generated Data

Title

Aaron Siskind

People

Artist: Unidentified Artist,

Date

c. 1930

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Accessory 97.7
Tie 97.7
Accessories 97.7
Person 96.7
Human 96.7
Coat 92.2
Suit 92.2
Apparel 92.2
Clothing 92.2
Overcoat 92.2
Performer 83.2
Furniture 74.3
Photography 60.3
Face 60.3
Portrait 60.3
Photo 60.3
Table 57.2
Meal 56.2
Food 56.2

Imagga
created on 2021-12-15

office 46.6
business 42.6
businessman 40.6
man 39.7
person 36.2
people 32.9
male 32.9
suit 32.8
corporate 32.7
professional 31.9
call 31.4
adult 31.3
executive 29.9
work 29.9
computer 29.4
sitting 29.2
businesswoman 26.4
laptop 25
portrait 24.6
desk 22.5
smiling 21.7
working 21.2
confident 20.9
groom 20.6
happy 20.1
attractive 19.6
smile 19.3
handsome 18.7
manager 18.6
job 18.6
looking 18.4
businesspeople 18
necktie 18
table 17.9
bow tie 17.6
expression 17.1
face 17.1
tie 16.1
success 16.1
career 16.1
cheerful 14.6
indoor 14.6
group 14.5
lifestyle 14.5
worker 14.5
meeting 14.1
indoors 14.1
holding 14
communication 13.4
technology 13.4
modern 13.3
alone 12.8
company 12.1
men 12
successful 11.9
room 11.5
workplace 11.4
telephone 11.4
clothing 11.3
pretty 11.2
home 11.2
phone 11.1
black 11
team 10.8
formal 10.5
education 10.4
teamwork 10.2
casual 10.2
notebook 10
one 9.7
partner 9.7
corporation 9.7
boss 9.6
serious 9.5
two 9.3
garment 9.2
director 9.2
occupation 9.2
20s 9.2
employee 9
colleagues 8.8
women 8.7
couch 8.7
glass 8.6
elegant 8.6
secretary 8.4
friendly 8.2
interior 8
look 7.9
couple 7.8
employment 7.7
busy 7.7
30s 7.7
leadership 7.7
hand 7.7
guy 7.6
fashion 7.5
book 7.5
shirt 7.5
glasses 7.4
student 7.4
monitor 7.3
entrepreneur 7.3
television 7.3
color 7.2
paper 7.1

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

wall 99.9
indoor 98.7
text 95.6
clothing 94.8
black and white 94.3
man 94.1
person 90
human face 88.2
gallery 61.7
room 50.6
picture frame 7.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 33-49
Gender Male, 99.5%
Calm 94.7%
Sad 2.9%
Confused 0.7%
Angry 0.7%
Happy 0.3%
Surprised 0.3%
Disgusted 0.2%
Fear 0.1%

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 97.7%
Person 96.7%
Suit 92.2%

Captions

Microsoft

Aaron Siskind standing in front of a mirror posing for the camera 34.9%
Aaron Siskind sitting in front of a mirror posing for the camera 29.4%
Aaron Siskind sitting on a table 29.3%

Text analysis

Amazon

Friday
:
t
10

Google

Friday
Friday