Human Generated Data

Title

Untitled (children riding on toy train)
Date

c. 1951
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15609

Human Generated Data

Title

Untitled (children riding on toy train)

People

Artist: Jack Gould, American

Date

c. 1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Furniture 100
Crib 99
Person 97.6
Human 97.6
Person 96.8
Person 96
Person 92.6
Person 70.1

Imagga
created on 2022-02-05

crib 100
baby bed 100
furniture 83.6
furnishing 52.1
home 22.3
interior 21.2
cradle 20.8
balcony 20.3
room 20.2
house 20
structure 18.7
wall 17.2
design 16.3
architecture 15.6
old 13.9
wooden 13.2
wood 12.5
texture 11.1
decoration 11
building 10.7
decor 10.6
paper 10.2
window 10.1
indoor 10
chair 10
menorah 9.7
residential 9.6
living 9.5
luxury 9.4
people 8.9
indoors 8.8
light 8.7
elegant 8.6
modern 8.4
frame 8.3
inside 8.3
vintage 8.3
person 8.2
retro 8.2
mansion 7.8
happiness 7.8
candelabrum 7.8
ancient 7.8
grunge 7.7
pattern 7.5
bedroom 7.4
style 7.4
man 7.4
bed 7.3
domestic 7.2
panel 7

Google
created on 2022-02-05

Outerwear 95.2
Organ 90.4
Sleeve 87.2
Line 82.4
Comfort 79.8
Rectangle 79.8
Font 79.5
Tints and shades 77.1
Magenta 75.9
Beauty 75.4
Fun 73.9
Toddler 70.8
Vintage clothing 69.8
Room 69.6
Wood 69.4
Happy 68.8
Sitting 67.9
Event 67.6
T-shirt 65.7
Child 65.2

Microsoft
created on 2022-02-05

person 96.4
human face 96.3
clothing 96.1
toddler 96
baby 94.4
text 87.9
boy 77.4
furniture 76.6
child 58.2
baby bed 50.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-7
Gender Male, 99.6%
Calm 97.6%
Happy 1.1%
Surprised 0.4%
Confused 0.2%
Angry 0.2%
Fear 0.2%
Disgusted 0.2%
Sad 0.1%

AWS Rekognition

Age 1-7
Gender Female, 97.2%
Calm 87.9%
Surprised 4.8%
Sad 2.8%
Fear 1.4%
Happy 1%
Confused 1%
Disgusted 0.7%
Angry 0.4%

AWS Rekognition

Age 16-22
Gender Female, 60.9%
Calm 94.9%
Surprised 3.3%
Angry 0.7%
Confused 0.4%
Fear 0.2%
Sad 0.2%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 6-14
Gender Male, 54.8%
Calm 46%
Happy 32.7%
Confused 11.3%
Angry 4.7%
Surprised 1.8%
Fear 1.5%
Sad 1.3%
Disgusted 0.7%

AWS Rekognition

Age 48-54
Gender Male, 99.5%
Happy 58.6%
Calm 19.3%
Confused 11.5%
Surprised 3.4%
Sad 2.3%
Angry 1.7%
Disgusted 1.7%
Fear 1.6%

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 2
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Likely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Crib 99%
Person 97.6%

Captions

Microsoft

an old photo of a boy 36.5%

Text analysis

Amazon

ST.
CITY
CITY OF ST. LOUIS
OF
LOUIS

Google

CITY OF ST. LOUIS
ST.
CITY
OF
LOUIS