Human Generated Data

Title

Untitled (two women facing each other along fence on outdoor patio with dog in foreground)

Date

1961

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9821

Human Generated Data

Title

Untitled (two women facing each other along fence on outdoor patio with dog in foreground)

People

Artist: Martin Schweig, American 20th century

Date

1961

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Clothing 99.1
Apparel 99.1
Human 96.2
Person 96.2
Handrail 92.2
Banister 92.2
Railing 87.2
Shorts 81.9
Outdoors 74.9
Porch 70.2
Nature 65.9
Person 65.7
Animal 65.6
Bird 65.6
Female 64.6
Face 63.4
Dress 62.4
Hat 60.9
Brick 58.2
Building 55.3
Floor 55.2

Imagga
created on 2022-01-28

fountain 48.1
structure 37.7
sky 24.2
silhouette 22.4
sunset 21.6
man 20.8
water 20
people 19
beach 16.2
person 15.5
world 14.9
landscape 14.9
male 14.2
sea 14.1
black 13.8
outdoors 13.5
travel 13.4
park 12.4
sun 12.2
summer 12.2
skateboard 12.1
light 12
sport 11.7
ocean 11.6
outdoor 11.5
night 10.7
stringed instrument 10.5
snow 10.2
clouds 10.1
wheeled vehicle 10.1
exercise 10
life 9.8
board 9.8
musical instrument 9.7
smoke 9.3
dark 9.2
peaceful 9.2
leisure 9.1
vacation 9
men 8.6
season 8.6
newspaper 8.6
old 8.4
recreation 8.1
sand 8
love 7.9
adult 7.9
destruction 7.8
scene 7.8
cold 7.7
sitting 7.7
tree 7.7
sunrise 7.5
human 7.5
symbol 7.4
alone 7.3
business 7.3
danger 7.3
religion 7.2
trees 7.1
vehicle 7.1
businessman 7.1
model 7

Google
created on 2022-01-28

Microsoft
created on 2022-01-28

tree 99.6
outdoor 95.7
black and white 89.5
text 80.5
wedding dress 67.5
street 59.7
person 53.1

Face analysis

Amazon

Google

AWS Rekognition

Age 20-28
Gender Female, 86.9%
Calm 66%
Sad 14.5%
Angry 6%
Confused 5.9%
Surprised 3.3%
Disgusted 1.7%
Fear 1.7%
Happy 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.2%
Bird 65.6%

Captions

Microsoft

a person standing in front of a building 79.8%
a person riding a skateboard up the side of a building 27.3%
a person standing in front of a window 27.2%

Text analysis

Amazon

PRICH