Human Generated Data

Title

Untitled (three men playing instruments in fancy carpeted room)
Date

1941
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10240

Human Generated Data

Title

Untitled (three men playing instruments in fancy carpeted room)

People

Artist: Martin Schweig, American 20th century

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.2
Human 99.2
Person 98.2
Person 96.5
Musical Instrument 95.2
Leisure Activities 91.6
Musician 90.2
Person 89.6
Fiddle 86.6
Violin 86.6
Viola 86.6
Cello 77.2
Tie 68.2
Accessory 68.2
Accessories 68.2
Music Band 66.5

Imagga
created on 2022-01-22

bowed stringed instrument 40.5
musical instrument 39.3
man 38.3
business 37
businessman 36.2
stringed instrument 34.2
oboe 34.2
male 32.6
wind instrument 32.1
people 29.6
corporate 27.5
meeting 26.4
violin 25.4
office 24.9
group 24.2
person 23.4
adult 22.3
businesswoman 21.8
suit 20.7
team 19.7
woodwind 18.7
work 18
businesspeople 17.1
executive 16.6
laptop 16.4
handsome 16
communication 16
professional 15.9
women 15.8
bassoon 15.7
brass 15.5
men 15.5
happy 15
teamwork 14.8
education 14.7
together 13.1
couple 13.1
manager 13
cello 13
smile 12.8
attractive 12.6
outfit 12.4
job 12.4
presentation 12.1
success 12.1
room 11.8
confident 11.8
student 11.8
happiness 11.7
conference 11.7
holding 11.6
boss 11.5
talking 11.4
computer 11.2
modern 11.2
pretty 11.2
portrait 11
successful 11
smiling 10.8
worker 10.7
sax 10.4
table 10.4
building 10.3
two 10.2
finance 10.1
teacher 10
board 9.9
fashion 9.8
interior 9.7
device 9.7
working 9.7
indoors 9.7
looking 9.6
sitting 9.4
study 9.3
hand 9.1
black 9
musician 8.9
diverse 8.8
love 8.7
lifestyle 8.7
diversity 8.6
chair 8.5
guy 8.4
studio 8.4
leisure 8.3
cornet 8.3
technology 8.2
cheerful 8.1
viola 7.9
discussion 7.8
corporation 7.7
wall 7.7
casual 7.6
workplace 7.6
reading 7.6
career 7.6
notebook 7.5
phone 7.4
street 7.4
indoor 7.3
music 7.3
dress 7.2
romance 7.1

Google
created on 2022-01-22

Coat 92.9
Chair 89.1
Musical instrument 84.9
Suit 80.1
Event 70.9
Music 69.7
Vintage clothing 69.2
Stock photography 65
Musical instrument accessory 64.1
Musician 64.1
Sitting 61.6
History 58.2
Photo caption 58.1
Classic 58.1
Room 57
Recital 56.7
Formal wear 55.8
Composer 53.8
Piano 53.4
Employment 52.1

Microsoft
created on 2022-01-22

person 99.7
piano 99.2
musical instrument 97.8
music 93.1
window 90.3
text 85.3
musical keyboard 79.5
group 69.7
people 60.8
old 58.7
musician 53.8
jazz 52.2
cello 51.3
bowed instrument 40.1
concert band 19.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Calm 79.1%
Happy 15.3%
Disgusted 2.4%
Surprised 1.5%
Angry 0.7%
Confused 0.5%
Sad 0.3%
Fear 0.3%

AWS Rekognition

Age 37-45
Gender Male, 100%
Calm 97.9%
Angry 0.6%
Surprised 0.4%
Fear 0.4%
Happy 0.2%
Confused 0.2%
Disgusted 0.1%
Sad 0.1%

AWS Rekognition

Age 24-34
Gender Male, 99.7%
Calm 98.7%
Angry 0.4%
Sad 0.2%
Surprised 0.2%
Fear 0.1%
Confused 0.1%
Disgusted 0.1%
Happy 0%

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 40
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Tie 68.2%

Captions

Microsoft

a group of people standing next to a guitar 92.9%
a group of people standing next to a person holding a guitar 84.7%
a group of people standing in front of a instrument 84.6%

Text analysis

Amazon

PROOF
SAINT
SAINT LOUIS
LOUIS
MARTIN
MARTIN SCHWEIG
SCHWEIG
4

Google

PROOF MARTIN SCHWEIG SAINT LOUIS
MARTIN
SAINT
PROOF
LOUIS
SCHWEIG