Human Generated Data

Title

Untitled (son of Virgil Thaxton, near Mechanicsburg, Ohio)
Date

July 1938-August 1938
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1791
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (son of Virgil Thaxton, near Mechanicsburg, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 1938-August 1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 99.7
Person 99.7
Person 98.5
Furniture 93.9
Chair 93.2
Face 89.5
Person 80.1
Art 69
Portrait 67.7
Photography 67.7
Photo 67.7
Indoors 60.1
Room 59.2
Painting 57.4

Clarifai
created on 2018-03-23

people 99.9
one 99.8
adult 99.6
portrait 98.1
wear 97
painting 96.8
indoors 96.2
art 95.1
furniture 95
room 94.8
man 93.8
two 92.7
wall 89.9
woman 89.7
music 85.4
seat 84.8
child 84.1
sit 83.2
leader 81.8
window 80.9

Imagga
created on 2018-03-23

stucco 46.9
grunge 40
old 37.6
antique 34.2
vintage 33.1
texture 29.9
art 26.6
aged 25.3
retro 24.6
frame 23.3
ancient 22.5
wall 21.5
paper 19.7
pattern 19.1
decoration 18.2
rusty 17.1
wallpaper 16.8
design 16.4
dirty 16.3
material 15.2
textured 14.9
style 14.8
paint 14.5
border 13.6
weathered 13.3
floral 12.8
rough 12.8
architecture 12.6
decay 12.5
stained 12.5
stain 12.5
surface 12.3
brown 11.8
rust 11.6
parchment 11.5
worn 11.5
damaged 11.4
grungy 11.4
detail 11.3
structure 10.9
aging 10.5
flower 10
religion 9.9
history 9.8
metal 9.7
obsolete 9.6
canvas 9.5
culture 9.4
gold 9
torn 8.7
messy 8.7
blank 8.6
iron 8.5
historical 8.5
color 8.3
church 8.3
backdrop 8.2
artwork 8.2
ornate 8.2
interior 8
decor 8
grime 7.8
burnt 7.8
industry 7.7
god 7.7
building 7.6
decorative 7.5
traditional 7.5
plant 7.5
effect 7.3
graphic 7.3
card 7.3
text 7.1

Google
created on 2018-03-23

photograph 95.7
black and white 92.3
wall 90.2
room 85.8
snapshot 81.8
photography 78.6
monochrome photography 76.8
art 71.5
monochrome 68
plaster 60.9
wallpaper 59.8
visual arts 57.9
decor 55.7
portrait 54.4
vintage clothing 53.5
interior design 52.5

Microsoft
created on 2018-03-23

wall 99.5
indoor 98
person 96.2
posing 80.1
young 75.5

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 10-15
Gender Male, 89.8%
Confused 0.2%
Sad 0.1%
Calm 0.2%
Happy 98.9%
Surprised 0.2%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 26-43
Gender Female, 51.5%
Sad 46.7%
Surprised 45.4%
Calm 48.8%
Happy 47.8%
Angry 45.3%
Disgusted 45.8%
Confused 45.2%

AWS Rekognition

Age 35-52
Gender Female, 52.6%
Happy 45.1%
Calm 48%
Surprised 45.8%
Angry 45.7%
Confused 45.2%
Disgusted 45.3%
Sad 49.9%

Microsoft Cognitive Services

Age 11
Gender Female

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a man standing in front of a mirror posing for the camera 77.5%
a young man standing in front of a mirror posing for the camera 68%
a young boy standing in front of a mirror posing for the camera 39.9%