Human Generated Data

Title

Untitled (young boy and two girls in striped shirts holding two goats on grassy hill)
Date

1961
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9822

Human Generated Data

Title

Untitled (young boy and two girls in striped shirts holding two goats on grassy hill)

People

Artist: Martin Schweig, American 20th century

Date

1961

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Human 99.7
Person 99.7
Plant 99.6
Vegetation 99.6
Person 99.3
Outdoors 99
Yard 99
Nature 99
Grass 98.7
Tree 97.4
Smile 97
Face 97
Dog 96.8
Canine 96.8
Mammal 96.8
Pet 96.8
Animal 96.8
Forest 96.7
Woodland 96.7
Land 96.7
Clothing 96.7
Apparel 96.7
Ground 95.2
Play 94.9
Lawn 92.4
Park 92.4
Grove 90.6
Rural 90.4
Building 90.4
Shelter 90.4
Countryside 90.4
Female 89.2
Kid 89.2
Blonde 89.2
Girl 89.2
Woman 89.2
Teen 89.2
Child 89.2
Shorts 85.4
Furniture 84.7
Sitting 82.2
Ice 74.9
Field 74.2
Snow 72.5
Person 72.5
Boy 70.8
Food 69.9
Meal 69.9
Photography 69.9
Photo 69.9
Portrait 68.4
Pants 68.1
Grassland 68
Bench 63.2
Housing 58.9
Tire 56.7

Imagga
created on 2022-01-28

swing 100
plaything 100
mechanical device 100
mechanism 85
forest 35.7
snow 29.8
park 28.8
tree 26.1
cold 25.8
winter 25.5
child 25.4
landscape 23.8
outdoor 22.2
frost 20.2
outdoors 19.5
countryside 19.2
season 17.2
trees 16.9
rural 15.9
kid 15.1
fun 15
autumn 14.9
scene 14.7
walking 14.2
leisure 14.1
sprinkler 13.9
snowy 13.6
fall 13.6
people 13.4
walk 13.3
country 13.2
ice 12.9
male 12.4
woods 12.4
man 12.1
outside 12
branch 11.9
scenery 11.7
recreation 11.7
activity 11.7
lifestyle 11.6
frozen 11.5
sky 10.8
wood 10.8
road 10.8
active 10.8
frosty 10.8
light 10.7
water 10.7
family 10.7
covered 10.7
vacation 10.6
path 10.4
weather 10.3
summer 10.3
day 10.2
happiness 10.2
happy 10
freeze 9.7
hiking 9.6
love 9.5
sport 9.4
natural 9.4
children 9.1
snowfall 8.9
leaves 8.8
grass 8.7
boy 8.7
play 8.6
men 8.6
leaf 8.6
joy 8.4
father 8.3
peaceful 8.2
girls 8.2
morning 8.1
sunset 8.1
childhood 8.1
sun 8.1
together 7.9
couple 7.8
fog 7.7
dad 7.7
beach 7.6
kids 7.5
enjoy 7.5
field 7.5
lake 7.3
cheerful 7.3
playing 7.3
smiling 7.2
smile 7.1
portrait 7.1
mountain 7.1
river 7.1
adult 7.1
seasonal 7

Google
created on 2022-01-28

Plant 96.1
Vertebrate 92.1
Tree 86.6
Organism 85.9
People in nature 83.5
Grass 82.9
Adaptation 79.3
Monochrome 73.4
Monochrome photography 72.8
Vintage clothing 67.9
Art 67.7
Recreation 66.1
Soil 62.4
Visual arts 61.5
Forest 61.2
Paper product 60.5
History 58.5
Slope 58.3
Photographic paper 55.7
Photo caption 55.2

Microsoft
created on 2022-01-28

tree 99.9
outdoor 99.9
snow 95.4
grass 95.3
toddler 92
black and white 79.9
person 78.4
text 74.2
clothing 69.8
boy 69.6
baby 65.2
child 56.6

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Male, 98.8%
Surprised 38.5%
Happy 35.5%
Fear 14.2%
Calm 4.9%
Angry 2.6%
Sad 2.1%
Disgusted 1.1%
Confused 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Dog 96.8%

Captions

Microsoft

a group of people posing for a photo 85.1%
a group of people riding on the back of a horse 81.4%
a group of people posing for a picture 81.3%

Text analysis

Google

MJI7--YT 33A 2--AGO
33A
MJI7--YT
2--AGO