Human Generated Data

Title

Untitled (three photographs: boats on lake; group of boys playing horseshoes; game on field)

Date

c. 1935, printed later

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6142

Human Generated Data

Title

Untitled (three photographs: boats on lake; group of boys playing horseshoes; game on field)

People

Artist: Durette Studio, American 20th century

Date

c. 1935, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Collage 100
Advertisement 100
Poster 100
Person 98.7
Human 98.7
Person 98.3
Person 97.2
Person 97.1
Person 96.6
Person 95.5
Person 93
Person 92.6
Person 92
Vehicle 91.7
Transportation 91.7
Boat 91.7
Person 85
Person 84.1
Person 82.5
Person 82.5
Person 82.3
Person 82.1
Person 80.3
Boat 75
Person 74.4
Person 73
Person 72.9
Person 67
Person 65.7
Person 64.5
Person 60.1
Art 56.3
Person 42.6

Clarifai
created on 2019-11-16

people 98.6
group 96.2
man 93.3
adult 93.1
picture frame 92.9
water 91
no person 90.2
landscape 87.5
collage 87.1
woman 87.1
many 86.5
portrait 85.8
art 85.3
blank 85.1
bill 84.5
illustration 83.5
exhibition 82.9
desktop 82.7
outdoors 81.6
mirror 81.2

Imagga
created on 2019-11-16

window 36.2
billboard 32.5
structure 28.9
signboard 25.5
old 24.4
grunge 23.8
framework 22.3
screen 20.7
vintage 19.8
windowsill 18.3
texture 18.1
sky 17.8
window screen 17.8
antique 17.3
supporting structure 16.9
frame 15.8
landscape 14.9
sill 14.7
dirty 14.5
silhouette 14.1
water 14
protective covering 14
retro 13.9
design 13.6
aged 13.6
trees 13.3
black 13.2
rough 12.8
fence 12.7
paint 12.7
tree 12.5
material 12.5
weathered 12.3
decoration 12
covering 11.8
grungy 11.4
ancient 11.2
film 11.1
structural member 11.1
art 11.1
graphic 10.9
pattern 10.9
sunset 10.8
damaged 10.5
outdoors 10.4
lake 10.1
border 9.9
travel 9.9
collage 9.6
paper 9.4
winter 9.4
building 9.3
space 9.3
ocean 9.1
forest 8.7
rust 8.7
edge 8.7
barrier 8.6
beach 8.4
outdoor 8.4
calm 8.2
scenery 8.1
scratches 7.9
text 7.9
frames 7.8
scratch 7.8
messy 7.7
wallpaper 7.7
snow 7.6
reflection 7.6
poster 7.6
vacation 7.4
digital 7.3
yellow 7.3
sun 7.2
detail 7.2
color 7.2
computer 7.2
romantic 7.1
architecture 7.1
night 7.1
support 7
season 7
textured 7

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

gallery 94.9
room 90.6
text 83.3
scene 83.3
black and white 82.1
person 76.5
water 55.6
clothing 55.3

Face analysis

Amazon

AWS Rekognition

Age 0-4
Gender Female, 54.6%
Surprised 45.1%
Calm 45.1%
Fear 46.1%
Disgusted 45.1%
Happy 45.1%
Angry 45.4%
Sad 52.6%
Confused 45.5%

AWS Rekognition

Age 0-3
Gender Male, 50.2%
Calm 51.5%
Disgusted 45.1%
Surprised 45.1%
Fear 45.4%
Happy 45.3%
Angry 45.1%
Confused 45.4%
Sad 47.1%

AWS Rekognition

Age 0-3
Gender Female, 53.7%
Disgusted 45.2%
Confused 45.3%
Angry 45.9%
Sad 45.5%
Happy 45%
Surprised 48.8%
Calm 48.2%
Fear 46.1%

AWS Rekognition

Age 2-8
Gender Female, 50%
Calm 49.6%
Surprised 49.6%
Disgusted 49.5%
Happy 50.1%
Angry 49.5%
Confused 49.5%
Sad 49.6%
Fear 49.6%

AWS Rekognition

Age 9-19
Gender Female, 50.1%
Disgusted 49.5%
Calm 49.5%
Confused 49.5%
Sad 49.5%
Happy 50.5%
Angry 49.5%
Fear 49.5%
Surprised 49.5%

AWS Rekognition

Age 14-26
Gender Male, 50.3%
Confused 49.5%
Angry 49.9%
Surprised 49.5%
Calm 50%
Disgusted 49.5%
Fear 49.5%
Sad 49.5%
Happy 49.5%

AWS Rekognition

Age 18-30
Gender Female, 50%
Disgusted 49.5%
Confused 49.5%
Angry 50%
Happy 49.6%
Sad 49.6%
Calm 49.6%
Surprised 49.5%
Fear 49.5%

AWS Rekognition

Age 6-16
Gender Female, 50.1%
Fear 49.6%
Disgusted 49.6%
Surprised 49.5%
Sad 49.6%
Happy 49.7%
Confused 49.5%
Angry 49.9%
Calm 49.6%

AWS Rekognition

Age 19-31
Gender Male, 50.4%
Disgusted 49.6%
Happy 49.5%
Angry 49.6%
Confused 50.1%
Calm 49.6%
Fear 49.5%
Sad 49.6%
Surprised 49.5%

AWS Rekognition

Age 4-12
Gender Female, 50.2%
Calm 49.5%
Sad 49.9%
Happy 49.5%
Angry 49.8%
Fear 49.7%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 8-18
Gender Female, 50.1%
Calm 49.9%
Surprised 49.7%
Happy 49.6%
Sad 49.5%
Confused 49.5%
Angry 49.6%
Fear 49.6%
Disgusted 49.6%

AWS Rekognition

Age 16-28
Gender Female, 50.1%
Confused 49.5%
Calm 49.5%
Sad 49.5%
Surprised 49.5%
Happy 49.5%
Disgusted 49.5%
Fear 50.4%
Angry 49.5%

AWS Rekognition

Age 11-21
Gender Female, 50%
Angry 49.5%
Sad 50.1%
Confused 49.7%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Fear 49.6%
Calm 49.5%

AWS Rekognition

Age 13-23
Gender Female, 50.4%
Happy 50.3%
Confused 49.5%
Calm 49.6%
Fear 49.5%
Angry 49.5%
Surprised 49.5%
Disgusted 49.5%
Sad 49.5%

AWS Rekognition

Age 2-8
Gender Female, 50.1%
Calm 49.5%
Disgusted 49.5%
Happy 49.5%
Fear 49.5%
Surprised 49.5%
Sad 50.5%
Confused 49.5%
Angry 49.5%

AWS Rekognition

Age 27-43
Gender Female, 50.2%
Disgusted 49.5%
Confused 49.5%
Sad 49.9%
Calm 49.5%
Angry 50%
Fear 49.6%
Surprised 49.5%
Happy 49.5%

Feature analysis

Amazon

Person 98.7%
Boat 91.7%

Captions

Microsoft

a group of people in a room 65%
a group of people standing in a room 55.5%
a group of people in a room with graffiti on the wall 54.5%