Human Generated Data

Title

Untitled (couples dancing at debutante ball)

Date

1965

People

Artist: Robert Burian, American active 1940s-1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19284

Human Generated Data

Title

Untitled (couples dancing at debutante ball)

People

Artist: Robert Burian, American active 1940s-1950s

Date

1965

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Human 98.6
Person 98.6
Person 97.9
Person 97.8
Person 97.6
Person 97.5
Person 96.9
Person 96.6
Person 96.2
Person 93.2
Clinic 88.8
Apparel 82.7
Clothing 82.7
Person 82.4
Person 82.1
Accessories 78.3
Tie 78.3
Accessory 78.3
Person 78.1
Person 72.7
Coat 63.9
People 60.6
Portrait 60
Photography 60
Photo 60
Face 60
Sleeve 58.9
Hospital 58.4

Imagga
created on 2022-03-05

businessman 39.7
professional 38.9
man 38.3
people 37.9
business 36.5
male 36.2
person 35
teacher 31.7
job 31
team 30.5
adult 29.8
corporate 28.4
businesswoman 27.3
teamwork 26
cornet 25.7
group 25
work 24.3
brass 23.9
educator 23.6
men 22.3
nurse 20.5
occupation 20.2
boss 20.1
wind instrument 19
office 18.5
happy 16.9
women 16.6
silhouette 16.6
bright 15.7
worker 15.4
crowd 15.4
meeting 15.1
success 14.5
presentation 14
musical instrument 13.8
smiling 13.8
suit 13.7
audience 13.7
clothing 13.6
groom 13.5
leader 13.5
executive 13.3
businesspeople 13.3
standing 13
building 12.8
speech 12.7
life 12.7
career 12.3
vibrant 12.3
vivid 12.1
cheering 11.8
nighttime 11.8
stadium 11.7
colleagues 11.7
portrait 11.7
patriotic 11.5
nation 11.4
modern 11.2
looking 11.2
flag 11.1
lights 11.1
day 11
communication 10.9
supporters 10.9
president 10.8
design 10.7
together 10.5
hall 10.5
icon 10.3
manager 10.3
company 10.2
symbol 10.1
successful 10.1
employee 10
smile 10
lab coat 10
human 9.8
sexy 9.6
room 9.6
profession 9.6
doctor 9.4
clothes 9.4
document 9.4
casual 9.3
mature 9.3
indoor 9.1
working 8.8
medical 8.8
40s 8.8
couple 8.7
corporation 8.7
partnership 8.6
happiness 8.6
black 8.4
health 8.3
patient 8.1
light 8
indoors 7.9
associates 7.9
hospital 7.8
hands 7.8
full length 7.8
leadership 7.7
two 7.6
talking 7.6
adults 7.6
desk 7.6
fashion 7.5
commerce 7.5
window 7.4
bride 7.4
confident 7.3
lifestyle 7.2
coat 7.2
dancer 7.1
pretty 7

Google
created on 2022-03-05

Sleeve 85.8
Gesture 85.3
Black-and-white 85.1
Style 83.9
Font 81.1
Monochrome photography 74.4
Monochrome 74.3
Event 73.8
Formal wear 70.9
Uniform 67.6
Art 65
Room 61.5
Photo caption 60.5
Service 58.5
Team 58
History 57.5
Suit 55.2
Ceremony 54.1
Happy 54
Hat 50.3

Microsoft
created on 2022-03-05

indoor 90.6
dance 88.5
wedding dress 87.4
person 87.1
clothing 86
text 85.5
woman 67.1
bride 59.5
black and white 58.6
dress 54.8

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Female, 74.4%
Sad 87.2%
Calm 7.6%
Confused 3.3%
Fear 0.7%
Angry 0.4%
Disgusted 0.3%
Happy 0.2%
Surprised 0.2%

AWS Rekognition

Age 41-49
Gender Female, 66.5%
Sad 69.4%
Calm 16.9%
Confused 7%
Disgusted 1.7%
Angry 1.7%
Happy 1.6%
Surprised 0.8%
Fear 0.8%

AWS Rekognition

Age 22-30
Gender Female, 93.2%
Calm 86.5%
Sad 7.1%
Angry 1.5%
Confused 1.2%
Disgusted 1.2%
Surprised 1%
Fear 0.9%
Happy 0.6%

AWS Rekognition

Age 30-40
Gender Male, 98.7%
Confused 32.6%
Disgusted 21.5%
Calm 17.8%
Sad 14.3%
Angry 4.6%
Surprised 3.5%
Fear 3.5%
Happy 2.3%

AWS Rekognition

Age 34-42
Gender Male, 99.6%
Disgusted 38.5%
Confused 13.9%
Calm 12.7%
Fear 10.3%
Sad 7.6%
Angry 6.4%
Surprised 6.1%
Happy 4.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person 98.6%
Tie 78.3%

Captions

Microsoft

a group of people posing for a photo 72.1%
a group of people standing in a room 72%
a group of people posing for the camera 71.9%

Text analysis

Amazon

EXIT
8
7E
MJIA
MJIA YT37A2
MAOOX
YT37A2
M 113
YT33
YT33 до2
XIOO
до2

Google

EXIT
T
EXIT EXIT MJI3 Y T 33 A2 MAGOX
Y
33
A2
MJI3
MAGOX