Human Generated Data

Title

Untitled (men and woman at party)

Date

1952

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20279

Human Generated Data

Title

Untitled (men and woman at party)

People

Artist: Peter James Studio, American

Date

1952

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.6
Human 99.6
Clothing 99.2
Apparel 99.2
Person 98.9
Person 97.2
Person 96.3
Person 94.9
Coat 87.2
Clinic 74.2
Overcoat 72.9
Suit 71.2
Accessories 66.5
Accessory 66.5
Tie 66.5
Furniture 65.9
Interior Design 63.6
Indoors 63.6
People 62.7
Person 62.3
Shirt 61.5
Sleeve 59.5
Lab Coat 58
Suit 57
Face 56

Imagga
created on 2022-03-05

man 49.7
executive 49.6
male 44
business 37.7
people 36.3
businessman 36.2
person 35.1
office 34.2
professional 33.3
adult 31.4
men 28.3
meeting 28.3
worker 27.2
work 26.7
job 26.5
working 26.5
happy 26.3
corporate 25.8
team 25.1
teamwork 23.2
businesspeople 21.8
waiter 20.8
colleagues 20.4
smiling 20.3
group 19.3
suit 18.7
businesswoman 18.2
employee 17.7
portrait 17.5
women 17.4
smile 17.1
looking 16.8
indoors 16.7
coat 16.4
patient 16.3
lab coat 16.2
success 16.1
doctor 16
occupation 15.6
table 15.6
mid adult 15.4
dining-room attendant 15.1
manager 14.9
together 14.9
modern 14.7
successful 14.6
30s 14.4
building 14.4
mature 13.9
clothing 13.9
coworkers 13.8
sitting 13.7
lifestyle 13.7
confident 13.6
hospital 13.6
casual 13.6
handsome 13.4
attractive 13.3
medical 13.2
surgeon 13.1
associates 12.8
partnership 12.5
couple 12.2
senior 12.2
home 12
indoor 11.9
kitchen 11.6
cheerful 11.4
career 11.4
desk 11.3
standing 11.3
computer 11.2
room 11.2
engineer 10.8
40s 10.7
partner 10.6
busy 10.6
ethnic 10.5
health 10.4
company 10.2
happiness 10.2
20s 10.1
horizontal 10
color 10
clinic 10
businessmen 9.8
discussion 9.7
employment 9.7
staff 9.7
talking 9.5
industry 9.4
entrepreneur 9.4
restaurant 9.4
two 9.3
communication 9.2
laptop 9.1
technology 8.9
interior 8.8
conference 8.8
education 8.7
diversity 8.6
elderly 8.6
profession 8.6
formal 8.6
bright 8.6
workplace 8.6
face 8.5
adults 8.5
camera 8.3
care 8.2
garment 8.1
medicine 7.9
collaboration 7.9
colleague 7.8
black 7.8
middle aged 7.8
uniform 7.8
architect 7.7
corporation 7.7
boss 7.7
shop 7.5
human 7.5
holding 7.4
to 7.1
day 7.1
practitioner 7
look 7

Google
created on 2022-03-05

White 92.2
Black 89.6
Black-and-white 86.1
Style 84
Tie 77.9
Event 74.4
Monochrome 74.1
Monochrome photography 73.5
Formal wear 72.8
Cooking 70.3
White-collar worker 69.9
Uniform 65.6
History 64.3
Vintage clothing 64.2
Conversation 63.3
Hat 62.8
Suit 61.4
Ceremony 56.8
Room 55.9

Microsoft
created on 2022-03-05

person 99.5
clothing 97.8
man 92
text 83
standing 78.8
black and white 74.7
woman 54.8

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Male, 98.9%
Calm 99.9%
Surprised 0%
Sad 0%
Disgusted 0%
Fear 0%
Angry 0%
Happy 0%
Confused 0%

AWS Rekognition

Age 48-54
Gender Female, 64.8%
Calm 90.3%
Sad 4.6%
Happy 2.6%
Surprised 1.1%
Confused 0.8%
Disgusted 0.3%
Angry 0.3%
Fear 0.1%

AWS Rekognition

Age 52-60
Gender Female, 67.2%
Calm 50%
Sad 47.1%
Confused 1.5%
Surprised 0.7%
Disgusted 0.3%
Angry 0.2%
Happy 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Suit 71.2%
Tie 66.5%

Captions

Microsoft

a group of people standing in front of a window 88.7%
a group of men standing in front of a window 84.2%
a group of people standing next to a window 84.1%

Text analysis

Amazon

THE
THE HO
HO
DE