Human Generated Data

Title

Untitled (couple in child costumes posing at party with male server behind them)

Date

1950

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9308

Human Generated Data

Title

Untitled (couple in child costumes posing at party with male server behind them)

People

Artist: Martin Schweig, American 20th century

Date

1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 97.7
Apparel 97.7
Human 94.1
Person 84.2
Person 84.1
Art 83.8
Indoors 72.1
Drawing 68
Room 67.8
Female 67.4
Face 60.3
Gown 57.9
Fashion 57.9
Furniture 56.1
Robe 55.9

Imagga
created on 2022-01-23

case 31.6
window 23.6
device 21.9
room 20.9
interior 20.3
house 18.4
home 18.3
ventilator 16.7
furniture 15.1
window shade 14.9
architecture 14.8
luxury 14.6
design 14.1
modern 14
decor 13.3
indoors 13.2
indoor 12.8
business 12.7
table 12.4
floor 12.1
window blind 12
wall 11.5
man 11.4
light 10.7
blackboard 10.6
working 10.6
blind 10
wood 10
computer 9.7
old 9.7
style 9.6
real 9.5
people 9.5
person 9.3
windowsill 9.2
building 9.1
one 8.9
technology 8.9
monitor 8.9
door 8.6
glass 8.5
estate 8.5
office 8.4
portrait 8.4
elegance 8.4
equipment 8.4
inside 8.3
vintage 8.3
lady 8.1
art 8.1
looking 8
black 7.9
protective covering 7.8
space 7.8
sitting 7.7
frame 7.7
elegant 7.7
flower 7.7
residential 7.7
comfortable 7.6
living 7.6
contemporary 7.5
retro 7.4
support 7.3
sill 7.3
antique 7.2
domestic 7.2
male 7.1
copy 7.1
panel 7.1
businessman 7.1
travel 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

window 97.3
text 96.8
vase 92.1
sketch 77.1
drawing 72.4

Face analysis

Amazon

AWS Rekognition

Age 28-38
Gender Male, 88.8%
Calm 76.8%
Sad 13.7%
Happy 2.5%
Confused 1.9%
Fear 1.7%
Disgusted 1.6%
Angry 1.3%
Surprised 0.6%

AWS Rekognition

Age 41-49
Gender Male, 100%
Sad 43.5%
Calm 27.2%
Surprised 13.4%
Angry 5.7%
Confused 4%
Happy 3.7%
Disgusted 1.7%
Fear 0.9%

Feature analysis

Amazon

Person 84.2%

Captions

Microsoft

a person standing in front of a window 64%
a person standing next to a window 56.5%
a person standing in front of a window 56.4%

Text analysis

Amazon

KODAK-SEL

Google

YT37A2-XAGO 00
YT37A2-XAGO
00