Human Generated Data

Title

Untitled (four people at ball)

Date

1965

People

Artist: Robert Burian, American active 1940s-1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19282

Human Generated Data

Title

Untitled (four people at ball)

People

Artist: Robert Burian, American active 1940s-1950s

Date

1965

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.5
Apparel 99.5
Person 98.3
Human 98.3
Person 96.7
Person 96.7
Person 95.1
Sleeve 93
Long Sleeve 78.1
Female 77.4
Coat 77.1
Overcoat 75.6
Suit 75.6
Evening Dress 69.4
Robe 69.4
Fashion 69.4
Gown 69.4
Woman 61.8
Furniture 59.1
Chair 59.1
Face 56.3
Photo 55.6
Photography 55.6

Imagga
created on 2022-03-05

groom 69.9
man 45.1
business 45
corporate 44.7
professional 44.6
businessman 41.5
male 39.8
office 35.8
executive 34.9
adult 34.8
people 34.6
happy 33.2
team 32.3
building 31
teamwork 30.6
meeting 30.2
businesswoman 29.1
suit 28.4
group 27.4
teacher 27.2
person 26.8
success 24.2
successful 23.8
work 23.6
attractive 23.1
businesspeople 22.8
men 22.3
smile 21.4
diversity 21.2
women 20.6
handsome 19.6
colleagues 19.4
partnership 19.2
educator 19.2
handshake 18.6
happiness 18
job 17.7
couple 17.4
communication 16.8
manager 16.8
diverse 16.7
partner 16.4
black 16.4
confident 16.4
portrait 16.2
pretty 16.1
boss 15.3
two 15.3
ethnic 15.2
company 14.9
worker 14.8
businessmen 14.6
smiling 14.5
career 14.2
standing 13.9
corporation 13.5
talking 13.3
hands 13
bride 12.8
shake 12.7
leadership 12.5
lifestyle 12.3
employee 12
mature 11.2
wedding 11
occupation 11
entrepreneur 11
holding 10.7
hand 10.6
working 10.6
fashion 10.6
lady 10.6
confidence 10.5
formal 10.5
workplace 10.5
dress 9.9
shaking 9.9
coworkers 9.8
baron 9.7
life 9.7
marriage 9.5
adults 9.5
outside 9.4
expression 9.4
secretary 9.4
20s 9.2
modern 9.1
jacket 8.9
looking 8.8
40s 8.8
love 8.7
day 8.6
tie 8.5
casual 8.5
commerce 8.4
cheerful 8.1
university 8.1
together 7.9
associates 7.9
face 7.8
education 7.8
agreement 7.8
deal 7.8
workers 7.8
busy 7.7
finance 7.6
bouquet 7.6
human 7.5
phone 7.4
friendly 7.3
indoor 7.3

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

person 98.7
clothing 96.5
dress 95.8
standing 95.2
suit 93.2
text 92.2
woman 89.3
black and white 83.6
man 73.1
coat 66.9
wedding dress 65.4
posing 37.1

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Male, 63.1%
Happy 62.8%
Calm 27.4%
Sad 3.9%
Disgusted 1.9%
Surprised 1.7%
Confused 1.3%
Fear 0.6%
Angry 0.5%

AWS Rekognition

Age 45-53
Gender Male, 99.4%
Surprised 42.5%
Sad 16.9%
Fear 16%
Calm 8.4%
Angry 6.9%
Happy 3.8%
Confused 3.3%
Disgusted 2.2%

AWS Rekognition

Age 31-41
Gender Male, 97.8%
Calm 82.2%
Happy 9.4%
Surprised 3.7%
Confused 1.8%
Sad 1.3%
Disgusted 0.7%
Angry 0.6%
Fear 0.3%

AWS Rekognition

Age 35-43
Gender Female, 58.6%
Calm 97.5%
Surprised 0.7%
Disgusted 0.6%
Fear 0.5%
Happy 0.3%
Sad 0.3%
Confused 0.1%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%

Captions

Microsoft

a group of people standing in front of a mirror posing for the camera 81%
a man and a woman standing in front of a building 80.9%
a group of people standing in front of a building 80.8%

Text analysis

Amazon

10
G 10
G
11
EXIT
AOOX
MAC
M117
M117 YY37A2 MAGOX
YY37A2
MAGOX
Mill YY37A2
Mill

Google

MJ13
Y
G 10 EXIT MJ13 Y T33 A2 XAGOX Mia YI 332 AC
10
T33
XAGOX
G
EXIT
Mia
332
A2
YI
AC