Human Generated Data

Title

Untitled (eight children preparing to play tug-of-war with baby sitting in stroller beside them)
Date

1961
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9830

Human Generated Data

Title

Untitled (eight children preparing to play tug-of-war with baby sitting in stroller beside them)

People

Artist: Martin Schweig, American 20th century

Date

1961

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Person 99.7
Human 99.7
Person 99.1
Person 98.9
Person 98.2
Person 96.5
Person 95.8
Tree 95.4
Plant 95.4
Apparel 95.4
Clothing 95.4
Person 95
Ground 94
Person 91.7
Shorts 89.1
Vegetation 87.9
Person 87.1
Outdoors 78.4
Land 72.4
Nature 72.4
Play 67.4
Female 64.2
Road 64.1
Child 62.7
Kid 62.7
Meal 62.4
Food 62.4
Grass 61.6
People 61.4
Face 61.2
Photo 58.5
Photography 58.5
Blossom 55.5
Flower 55.5
Girl 55.2

Imagga
created on 2022-01-28

maze 48.5
sky 27.4
landscape 24.5
sunset 23.4
sand 21.5
outdoors 21
plow 19.6
mountain 18.7
desert 18.7
sun 18.6
travel 17.6
silhouette 17.4
rock 17.4
tool 16
sprinkler 15.9
vacation 15.6
fountain 15.2
people 15.1
park 14.8
beach 14.6
outdoor 14.5
clouds 14.4
water 14
structure 14
tunnel 14
mechanical device 13.7
summer 13.5
man 12.8
sunrise 12.2
old 11.8
sea 11.7
stone 11.7
ocean 11.6
tree 11.6
tourism 11.6
scenic 11.4
canyon 10.9
environment 10.7
passageway 10.5
mechanism 10.2
person 9.9
trees 9.8
light 9.7
grunge 9.4
evening 9.3
male 9.2
orange 9.2
vintage 9.1
cliff 9.1
adult 9.1
sport 8.9
couple 8.7
forest 8.7
hiking 8.7
outside 8.6
mountains 8.3
land 8.3
national 8.2
road 8.1
recreation 8.1
life 8
yellow 8
country 7.9
happiness 7.8
fence 7.8
valley 7.8
passage 7.8
sunny 7.8
dusk 7.6
two 7.6
wilderness 7.6
serene 7.5
hill 7.5
picket fence 7.4
dry 7.4
retro 7.4
child 7.4
peaceful 7.3
countryside 7.3
lifestyle 7.2
scenery 7.2
holiday 7.2
grass 7.1
love 7.1
rural 7.1
autumn 7

Google
created on 2022-01-28

Plant 88.5
Tree 85.3
Gesture 85.3
Adaptation 79.2
Grass 78
Tints and shades 76.6
Monochrome photography 73.8
Monochrome 72.6
Vintage clothing 70.2
Stock photography 63.5
Team 62.3
Photo caption 59.7
History 59.3
Child 57.5
Crew 57.1
Recreation 55.3
Pole 55.1
Uniform 54.9
Art 51

Microsoft
created on 2022-01-28

grass 98.9
tree 97.7
outdoor 94.6
text 91.5
black and white 79.4
posing 49.6

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Male, 93.6%
Calm 69.3%
Sad 15.7%
Fear 4.5%
Happy 2.9%
Confused 2.3%
Disgusted 2.3%
Angry 1.5%
Surprised 1.5%

AWS Rekognition

Age 14-22
Gender Female, 82.5%
Calm 84.6%
Sad 10.4%
Happy 2.2%
Surprised 0.8%
Confused 0.6%
Angry 0.6%
Disgusted 0.5%
Fear 0.2%

AWS Rekognition

Age 23-31
Gender Male, 95.2%
Calm 42.9%
Sad 30.3%
Fear 15.4%
Happy 4.9%
Surprised 2.8%
Confused 2.2%
Disgusted 0.9%
Angry 0.6%

AWS Rekognition

Age 18-26
Gender Male, 91.7%
Calm 47.5%
Fear 18.1%
Sad 16.5%
Confused 7.1%
Surprised 5.8%
Happy 2.3%
Angry 1.7%
Disgusted 1%

AWS Rekognition

Age 18-24
Gender Female, 93.2%
Sad 68.9%
Calm 20.9%
Happy 3.4%
Angry 2.4%
Surprised 2.1%
Fear 1.3%
Disgusted 0.7%
Confused 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

an old photo of a person 80.2%
an old photo of a boy 49.5%
old photo of a person 49.4%

Text analysis

Google

MJI7--
YT37A°2
MJI7-- YT37A°2 - - XAGON
-
XAGON