Human Generated Data

Title

Untitled (five ladies around desk signing document, from Council of Churches)

Date

May 1956

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18015

Human Generated Data

Title

Untitled (five ladies around desk signing document, from Council of Churches)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

May 1956

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-04

Human 99.5
Person 99.5
Person 99.4
Person 98.9
Person 98.8
Person 98.4
Symbol 86.6
Flag 86.6
Apparel 86.3
Clothing 86.3
Indoors 75.4
Piano 75.1
Leisure Activities 75.1
Musical Instrument 75.1
People 72.1
Chair 71.9
Furniture 71.9
Room 71.3
Chair 63.8
American Flag 57.5

Imagga
created on 2022-03-04

musical instrument 70.8
percussion instrument 70.6
marimba 58.1
stringed instrument 40.7
keyboard instrument 32.3
grand piano 30.1
piano 27.8
man 27.5
chair 25.6
table 24.6
sitting 23.2
male 20.5
people 19.5
interior 19.4
room 18
couple 17.4
harpsichord 17.2
person 16.7
smiling 16.6
furniture 16.5
happy 16.3
adult 15.7
office 15.2
lifestyle 15.2
smile 14.2
house 14.2
indoors 14
business 14
cheerful 13.8
clavier 13.7
businessman 12.3
device 12.2
home 11.9
love 11.8
happiness 11.7
relaxation 11.7
portrait 11.6
classroom 11.4
bench 11
modern 10.5
teacher 9.8
together 9.6
women 9.5
togetherness 9.4
inside 9.2
indoor 9.1
laptop 9.1
design 9
desk 8.6
glass 8.5
sit 8.5
side 8.4
professional 8.4
training 8.3
outdoors 8.2
style 8.1
group 8.1
computer 8
work 7.9
day 7.8
chairs 7.8
model 7.8
full length 7.7
mid adult 7.7
luxury 7.7
living 7.6
relax 7.6
meeting 7.5
horizontal 7.5
enjoyment 7.5
fun 7.5
leisure 7.5
floor 7.4
back 7.3
school 7.3
color 7.2
handsome 7.1

Google
created on 2022-03-04

Table 93.9
Furniture 93.6
Black 89.5
Coat 85.9
Chair 85
Dress 84.4
Style 84
Black-and-white 82.4
Adaptation 79.4
Suit 77
Art 76.7
Desk 75.4
Monochrome 74.5
Rectangle 74.4
Coffee table 73.8
Writing desk 73.2
Classic 72.7
Vintage clothing 71.6
Monochrome photography 70.4
Room 70.4

Microsoft
created on 2022-03-04

text 96.7
furniture 94.7
table 92.1
person 91.8
music 86.2
clothing 75.2
piano 73.1
black and white 72.4
man 72.2
chair 63
clavier 24.5

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 53.7%
Happy 48%
Calm 35.1%
Sad 6.5%
Fear 3.2%
Surprised 2.8%
Disgusted 2%
Angry 1.5%
Confused 0.9%

AWS Rekognition

Age 56-64
Gender Female, 95.8%
Calm 97.8%
Happy 1.2%
Fear 0.3%
Sad 0.2%
Surprised 0.2%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 40-48
Gender Female, 85.6%
Sad 62.8%
Calm 32%
Angry 1.2%
Confused 1.2%
Happy 0.8%
Fear 0.8%
Disgusted 0.6%
Surprised 0.6%

AWS Rekognition

Age 40-48
Gender Male, 73%
Calm 99.3%
Happy 0.4%
Sad 0.1%
Surprised 0.1%
Angry 0%
Confused 0%
Disgusted 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Piano 75.1%
Chair 71.9%

Captions

Microsoft

a group of people sitting and standing in front of a piano 94.2%
a group of people standing in front of a piano 94.1%
a group of people sitting at a piano 94%

Text analysis

Google

MJ17--YT37A°2
--
MJ17--YT37A°2 -- XAGON
XAGON