Human Generated Data

Title

Untitled (man and woman talking at cocktail party)
Date

1952
People

Artist: Peter James Studio, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20121

Human Generated Data

Title

Untitled (man and woman talking at cocktail party)

People

Artist: Peter James Studio, American

Date

1952

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Apparel 99.9
Clothing 99.9
Overcoat 99.3
Coat 99.3
Human 99
Person 99
Person 98.7
Person 95.3
Person 93.8
Tuxedo 93.4
Suit 81
Shirt 71
Man 64.8
Female 57.8
Person 43.2

Imagga
created on 2022-03-05

man 51.7
people 40.2
male 39.7
business 37
salon 36.4
office 36.4
professional 36
hairdresser 35.5
businessman 34.4
barbershop 30.8
executive 28.7
person 27.7
corporate 27.5
shop 26.4
handsome 25.8
happy 25.7
team 25.1
suit 24.8
adult 24.6
meeting 24.5
worker 24.1
men 24
working 23
success 22.5
senior 20.6
teamwork 20.4
portrait 20.1
smile 19.9
work 19.6
manager 19.6
job 19.5
successful 19.2
attractive 18.9
building 18.8
mercantile establishment 18.7
occupation 18.3
workplace 18.1
businesspeople 18
looking 16.8
indoors 16.7
group 16.1
company 15.8
mature 15.8
businesswoman 15.4
modern 15.4
smiling 15.2
career 15.1
partner 14.5
lifestyle 14.5
computer 14.4
elderly 14.4
partnership 13.4
medical 13.2
employment 12.6
leadership 12.5
place of business 12.5
standing 12.2
face 12.1
communication 11.8
mid adult 11.6
together 11.4
tie 11.4
doctor 11.3
sitting 11.2
old 11.1
industry 11.1
expression 11.1
women 11.1
casual 11
indoor 11
employee 10.7
talk 10.5
hospital 10.5
home 10.4
happiness 10.2
patient 10.2
room 10
laptop 10
coworkers 9.8
60s 9.8
consultant 9.7
colleagues 9.7
black 9.6
diversity 9.6
couple 9.6
bow tie 9.6
boss 9.6
desk 9.4
glasses 9.3
confident 9.1
care 9.1
health 9
two people 8.7
necktie 8.7
leader 8.7
formal 8.6
architecture 8.6
hand 8.4
clothing 8.3
phone 8.3
holding 8.3
engineer 8.2
alone 8.2
cheerful 8.1
medicine 7.9
expert 7.9
urban 7.9
businessperson 7.8
40s 7.8
table 7.8
architect 7.7
corporation 7.7
busy 7.7
helmet 7.7
skill 7.7
construction 7.7
pretty 7.7
profession 7.7
two 7.6
talking 7.6
entrepreneur 7.6
foreman 7.4
aged 7.2
color 7.2
gray 7.2
family 7.1
look 7

Google
created on 2022-03-05

Human 89.3
Sleeve 87.1
Black-and-white 86
Vision care 85.5
Style 84
Eyewear 81.8
Blazer 77.9
Monochrome photography 74.1
Event 73.9
White-collar worker 73.5
Hat 73.1
Monochrome 72.7
Fashion design 72.3
Tie 72.1
Formal wear 70.7
Pattern 64.9
Stock photography 62.3
Vintage clothing 61.8
Street fashion 61.8
Suit 61.2

Microsoft
created on 2022-03-05

person 99.9
text 94.7
clothing 92.9
black and white 89.1
standing 81.3
people 66.9
man 66
human face 60
dress 51.4

Face analysis

Amazon

Google

AWS Rekognition

Age 33-41
Gender Male, 97.4%
Calm 85%
Sad 4.1%
Confused 2.8%
Angry 2.2%
Surprised 1.8%
Fear 1.7%
Happy 1.4%
Disgusted 1%

AWS Rekognition

Age 50-58
Gender Female, 90.1%
Happy 93%
Calm 6.7%
Surprised 0.1%
Disgusted 0%
Sad 0%
Fear 0%
Angry 0%
Confused 0%

AWS Rekognition

Age 49-57
Gender Male, 87.3%
Calm 99.4%
Surprised 0.2%
Happy 0.1%
Disgusted 0.1%
Confused 0.1%
Angry 0%
Sad 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Suit 81%

Captions

Microsoft

a group of people standing in a room 95.8%
a group of people standing next to a man 92.1%
a group of people standing around each other 91.4%

Text analysis

Amazon

EAD
KODAK-.EELA

Google

YT37A°2-A
YT37A°2-A