Human Generated Data

Title

Untitled (ladies and gentlemen standing and drinking)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17148

Human Generated Data

Title

Untitled (ladies and gentlemen standing and drinking)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.7
Human 99.7
Person 99.5
Clothing 99.5
Apparel 99.5
Person 99.3
Person 99.2
Person 98.6
Person 97.8
Person 95.1
Female 94.6
Dress 85.8
Evening Dress 84.2
Gown 84.2
Fashion 84.2
Robe 84.2
Woman 82.9
Indoors 82
Suit 71.9
Coat 71.9
Overcoat 71.9
Person 70
Girl 68.7
Kid 67.4
Blonde 67.4
Teen 67.4
Child 67.4
People 66.2
Room 64.2
Photography 63.8
Portrait 63.8
Face 63.8
Photo 63.8
Furniture 62.7
Plant 61.7
Blossom 61.7
Flower 61.7
Shoe 61.2
Footwear 61.2
Wedding 59.2
Floor 58.2
Hair 57.5
Wedding Gown 55.8

Imagga
created on 2022-02-26

brass 69.2
wind instrument 55.7
musical instrument 39.8
man 29.5
person 29.5
people 29
male 25.5
cornet 23.5
professional 23.3
adult 21.8
businessman 21.2
trombone 20.8
business 20.6
teacher 19.7
men 18.9
musician 17.8
group 16.9
job 16.8
work 16.5
crowd 16.3
team 16.1
silhouette 14.9
singer 14.4
sexy 13.6
music 13.6
outfit 13
teamwork 13
businesswoman 12.7
corporate 12
design 11.8
performer 11.7
concert 11.6
boss 11.5
educator 11.4
device 11.2
style 11.1
women 11.1
youth 11.1
audience 10.7
musical 10.5
meeting 10.4
lights 10.2
occupation 10.1
happy 10
worker 9.9
modern 9.8
fashion 9.8
cheering 9.8
nighttime 9.8
stadium 9.7
indoors 9.7
leader 9.6
vibrant 9.6
horn 9.6
black 9.6
patriotic 9.6
education 9.5
chair 9.5
nation 9.5
flag 9.2
bass 9.1
holding 9.1
to 8.8
guitar 8.8
speech 8.8
symbol 8.7
stage 8.7
couple 8.7
lifestyle 8.7
performance 8.6
bright 8.6
smile 8.5
portrait 8.4
elegance 8.4
presentation 8.4
clothing 8.1
star 8.1
dance 8.1
looking 8
interior 8
smiling 7.9
icon 7.9
supporters 7.9
president 7.8
happiness 7.8
boy 7.8
employee 7.8
party 7.7
attractive 7.7
executive 7.6
human 7.5
instrument 7.4
vivid 7.4
children 7.3
board 7.2
color 7.2
suit 7.2
holiday 7.2
handsome 7.1
love 7.1

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 90.8
clothing 88.4
person 74.2
dress 66
man 64.6
drawing 59.9
woman 54

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Male, 98.7%
Calm 38%
Happy 23.8%
Sad 21.3%
Confused 7.8%
Disgusted 3.4%
Angry 3.1%
Surprised 1.7%
Fear 0.9%

AWS Rekognition

Age 45-51
Gender Female, 53.7%
Calm 97.4%
Sad 1.7%
Happy 0.4%
Confused 0.2%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%

AWS Rekognition

Age 45-51
Gender Female, 66.7%
Calm 78.5%
Happy 15.3%
Angry 1.7%
Sad 1.6%
Disgusted 0.9%
Confused 0.8%
Surprised 0.7%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 61.2%

Captions

Microsoft

a group of people standing in a room 92.2%
a group of people posing for a photo 78.9%
a group of people in a room 78.8%

Text analysis

Amazon

41
I34
KODAK-EVEELA

Google

YT37A2-
XAG
YT37A2- XAG