Human Generated Data

Title

Untitled (four people at ball)

Date

1965

People

Artist: Robert Burian, American active 1940s-1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19281

Human Generated Data

Title

Untitled (four people at ball)

People

Artist: Robert Burian, American active 1940s-1950s

Date

1965

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Apparel 99.9
Clothing 99.9
Suit 97.9
Overcoat 97.9
Coat 97.9
Human 97.3
Person 97.1
Person 96.5
Fashion 96.3
Robe 96.3
Person 96
Gown 95
Person 93.5
Wedding 89
Tuxedo 87.7
Wedding Gown 78.4
Bride 75.5
Bridegroom 74.5
Female 72.7
Long Sleeve 67.7
Sleeve 67.7
Person 65.3
People 60.5
Text 58.7
Evening Dress 57.9
Woman 55.9
Crowd 55.3

Imagga
created on 2022-02-25

corporate 42.1
business 41.9
man 39.7
professional 37.7
businessman 37.1
male 35.6
people 33.5
team 33.2
office 33
suit 30.3
building 29.8
teamwork 26.9
work 26.7
adult 26.5
happy 25.7
meeting 25.4
person 24.8
groom 24.7
attractive 24.5
group 24.2
success 22.5
businesswoman 21.8
teacher 21.3
men 20.6
smile 20
women 19.8
black 19.4
executive 19.4
diversity 19.2
ethnic 19
successful 18.3
pretty 18.2
worker 17.7
job 17.7
life 16.9
diverse 15.7
partnership 15.4
communication 15.1
company 14.9
educator 14.5
boss 14.4
businesspeople 14.2
portrait 13.6
two 13.6
handsome 13.4
manager 13
handshake 12.7
colleagues 12.6
career 12.3
standing 12.2
youth 11.9
partner 11.6
corporation 11.6
talking 11.4
modern 11.2
smiling 10.9
lifestyle 10.8
fashion 10.6
lady 10.6
hands 10.4
looking 10.4
phone 10.1
occupation 10.1
working 9.7
workers 9.7
profession 9.6
employee 9.5
outside 9.4
happiness 9.4
briefcase 9.3
clothing 9.2
human 9
shake 8.8
architecture 8.8
urban 8.7
couple 8.7
education 8.7
tie 8.5
walking 8.5
adults 8.5
commerce 8.4
friendly 8.2
student 8.2
interior 8
shaking 7.9
day 7.9
colleague 7.8
conference 7.8
businessmen 7.8
discussion 7.8
deal 7.8
leadership 7.7
sales 7.7
expression 7.7
workplace 7.6
city 7.5
style 7.4
dress 7.2
cute 7.2
bride 7.1
jacket 7.1
together 7

Google
created on 2022-02-25

Microsoft
created on 2022-02-25

text 98.8
wedding dress 97.5
bride 95.6
suit 94.9
clothing 94.5
person 94.2
dress 93
standing 90.2
woman 89
gallery 87
people 81.4
wedding 79
scene 70.9
man 68.8
room 67.2
smile 63.2
group 55.7
posing 42.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-35
Gender Male, 98%
Calm 87.8%
Confused 3.7%
Happy 3.3%
Surprised 3%
Disgusted 0.9%
Angry 0.7%
Fear 0.4%
Sad 0.3%

AWS Rekognition

Age 16-24
Gender Male, 100%
Happy 99.7%
Calm 0.2%
Fear 0%
Angry 0%
Surprised 0%
Confused 0%
Sad 0%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Female, 99.1%
Calm 72.6%
Happy 8.8%
Sad 4.3%
Angry 4.2%
Confused 3.8%
Disgusted 2.5%
Fear 2%
Surprised 1.7%

AWS Rekognition

Age 33-41
Gender Female, 99.8%
Calm 84.6%
Confused 6.9%
Happy 4.4%
Angry 1.7%
Sad 0.8%
Disgusted 0.6%
Surprised 0.5%
Fear 0.4%

Microsoft Cognitive Services

Age 25
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.1%

Captions

Microsoft

a group of people standing in front of a mirror posing for the camera 80.2%
a group of people standing in front of a door 80.1%
a group of people standing in a room 80%

Text analysis

Amazon

JAN
65
127
EXIT
132

Google

JAN
JAN してt 132
t
132