Human Generated Data

Title

Untitled (man in top hat performing for children's party)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17201

Human Generated Data

Title

Untitled (man in top hat performing for children's party)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Tree 99.6
Plant 99.6
Person 99.1
Human 99.1
Person 99
Person 98.6
Person 98.5
Person 95.9
Ornament 95.7
Person 95
Person 94.1
Person 94.1
Guitar 92.2
Musical Instrument 92.2
Leisure Activities 92.2
Person 90.4
Person 87.9
Christmas Tree 83.5
Person 75.5
Furniture 74.1
Chair 74.1
Interior Design 73
Indoors 73
Crowd 69
Fir 62.5
Abies 62.5
Musician 59.6
Pottery 59.2
Vase 59.2
Jar 59.2
Potted Plant 59.2
Living Room 59
Room 59

Imagga
created on 2022-02-26

musical instrument 38.1
man 31.5
stringed instrument 30.9
people 30.1
adult 28.6
male 28.3
person 28.1
violin 26.9
teacher 25.4
brass 24
bowed stringed instrument 23.5
happy 21.9
wind instrument 21.6
home 20.7
room 18.7
couple 18.3
smiling 17.3
banjo 17
professional 16
portrait 14.9
educator 14.5
family 14.2
mature 13.9
chair 13.7
smile 13.5
businessman 13.2
together 13.1
senior 13.1
school 12.5
interior 12.4
indoors 12.3
group 12.1
men 12
sitting 12
old 11.8
happiness 11.7
lifestyle 11.6
business 11.5
education 11.2
modern 11.2
women 11.1
handsome 10.7
classroom 10.6
music 10.5
barbershop 10.4
enjoying 10.4
indoor 10
shop 9.9
hand 9.9
office 9.6
black 9.6
cornet 9.6
boy 9.6
mother 9.5
desk 9.4
holiday 9.3
two 9.3
board 9
child 9
blackboard 9
computer 8.8
looking 8.8
teaching 8.8
table 8.6
studying 8.6
husband 8.6
casual 8.5
executive 8.4
study 8.4
guitar 8.3
student 8.3
holding 8.2
fun 8.2
worker 8.2
cheerful 8.1
kid 8
job 8
hair 7.9
work 7.8
day 7.8
corporate 7.7
class 7.7
elderly 7.7
businesspeople 7.6
wife 7.6
communication 7.5
fashion 7.5
learning 7.5
friends 7.5
human 7.5
friendship 7.5
vintage 7.4
lady 7.3
playing 7.3
new 7.3
confident 7.3
romantic 7.1
father 7.1
love 7.1
to 7.1

Microsoft
created on 2022-02-26

person 94.3
indoor 93.1
text 91.8
christmas tree 90.9
clothing 89.9
man 76.8
people 59.1
human face 56.4
crowd 0.6

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Female, 91.1%
Calm 96.9%
Surprised 1%
Sad 0.9%
Happy 0.3%
Angry 0.3%
Disgusted 0.2%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 39-47
Gender Male, 82%
Calm 100%
Sad 0%
Surprised 0%
Confused 0%
Disgusted 0%
Happy 0%
Fear 0%
Angry 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Guitar 92.2%

Captions

Microsoft

a group of people in a room 94.9%
a group of people sitting in front of a crowd 81.3%
a group of people sitting at a table 80.6%