Human Generated Data

Title

Untitled (people in Hawaiian attire at Luau)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16434

Human Generated Data

Title

Untitled (people in Hawaiian attire at Luau)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Person 99.7
Human 99.7
Person 99
Person 98.9
Apparel 97.7
Clothing 97.7
Person 94.6
Face 91.4
Person 89.9
Female 84.2
Person 84
Furniture 83.9
Chair 83.9
Meal 82.9
Food 82.9
Dish 77.9
People 77
Sitting 74.2
Person 73.2
Person 72
Room 71.4
Indoors 71.4
Outdoors 70.5
Woman 69.8
Nature 69.7
Icing 67.2
Dessert 67.2
Cake 67.2
Creme 67.2
Cream 67.2
Person 66.6
Crowd 66.1
Photography 63.5
Photo 63.5
Girl 63.2
Plant 60.7
Person 60.7
Coat 60
Table 59.5
Man 57.4
Person 57.3
Restaurant 57
Child 56.1
Kid 56.1
Overcoat 55.3
Person 47

Imagga
created on 2022-02-11

people 27.9
person 26.9
man 24.9
negative 21.6
male 19.8
film 18.1
adult 17.8
medical 17.6
iron lung 17.3
work 16.5
salon 16.3
patient 15.4
professional 15.1
doctor 15
senior 15
medicine 14.1
respirator 13.8
team 13.4
love 13.4
photographic paper 13.3
health 13.2
couple 13.1
coat 12.9
laboratory 12.5
working 12.4
portrait 12.3
men 12
human 12
women 11.9
lab 11.7
equipment 11.5
test 11.5
retro 11.5
room 11.3
happy 11.3
hospital 11
smiling 10.8
worker 10.7
breathing device 10.6
hand 10.6
chemical 10.6
bride 10.5
biology 10.4
technology 10.4
surgeon 10.4
groom 10.2
care 9.9
clinic 9.8
scientist 9.8
science 9.8
family 9.8
old 9.7
cheerful 9.7
business 9.7
chemistry 9.7
research 9.5
instrument 9.4
holiday 9.3
nurse 9.2
student 9.2
wedding 9.2
dress 9
biochemistry 8.9
chemist 8.9
photographic equipment 8.8
device 8.8
biotechnology 8.8
businessman 8.8
indoors 8.8
scientific 8.7
hair 8.7
education 8.7
scene 8.6
development 8.6
mature 8.4
vintage 8.3
aged 8.1
suit 8.1
together 7.9
happiness 7.8
modern 7.7
elderly 7.6
illness 7.6
decoration 7.4
teamwork 7.4
lady 7.3
home 7.2
smile 7.1
antique 7
look 7

Google
created on 2022-02-11

Microsoft
created on 2022-02-11

person 97.3
text 93.9
clothing 87.8
window 84.6
people 70.2
black and white 63.7
group 56.2
drawing 53.4
man 52.6

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Female, 87.6%
Surprised 41.9%
Happy 20.7%
Sad 17.7%
Confused 12.4%
Calm 2.6%
Disgusted 2.1%
Angry 1.4%
Fear 1.1%

AWS Rekognition

Age 40-48
Gender Male, 50.5%
Calm 98.6%
Angry 0.4%
Happy 0.3%
Sad 0.3%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people standing next to a window 92.1%
a group of people posing for a photo 92%
a group of people standing in front of a window 91.3%

Text analysis

Amazon

2