Human Generated Data

Title

Untitled (flower girls on staircase)
Date

1950s, printed later
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.922

Human Generated Data

Title

Untitled (flower girls on staircase)

People

Artist: Martin Schweig, American 20th century

Date

1950s, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Handrail 100
Banister 100
Person 97.6
Human 97.6
Railing 88
Person 75.3
Person 67.2
Staircase 58.1

Imagga
created on 2022-01-08

step 57.9
support 53.8
device 34.8
barrier 33.1
architecture 28.1
structure 27.7
railing 27.5
obstruction 24.2
house 20.9
building 20.6
balcony 20.2
city 17.4
old 16.7
urban 14.8
window 14.6
design 14.6
construction 14.5
baluster 14.3
interior 14.1
wall 13.7
home 13.5
light 13.4
metal 12.9
stairs 11.9
modern 11.2
musical instrument 10.7
black 10.2
percussion instrument 10.2
street 10.1
staircase 9.8
indoors 9.7
entrance 9.7
office 9.6
iron 9.3
business 9.1
to 8.8
steps 8.8
high 8.7
ancient 8.6
art 8.4
floor 8.4
town 8.3
exterior 8.3
tourism 8.2
style 8.1
rifle 8
glass 7.8
travel 7.7
lamp 7.6
frame 7.5
reflection 7.3
wooden 7

Google
created on 2022-01-08

Wood 86.5
Stairs 86.1
Font 80.8
Baluster 76.8
Tints and shades 76.2
Fence 75.3
Handrail 71.2
Monochrome photography 68.7
Monochrome 67.9
Tree 67.5
Pattern 67.4
Stock photography 65
Room 64.9
Rectangle 62.3
Visual arts 61.1
Art 61.1
Vintage clothing 60.8
Plucked string instruments 60.5
Illustration 59.9
Metal 59.3

Microsoft
created on 2022-01-08

music 73.3
person 56.1
step 32.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-12
Gender Female, 99.8%
Happy 98.8%
Fear 1%
Surprised 0.1%
Calm 0%
Sad 0%
Confused 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 2-10
Gender Female, 100%
Happy 87.7%
Calm 6.5%
Confused 2.2%
Angry 2%
Disgusted 0.6%
Surprised 0.4%
Sad 0.4%
Fear 0.2%

AWS Rekognition

Age 2-8
Gender Female, 97.3%
Calm 81.6%
Happy 14.7%
Sad 1.5%
Confused 0.7%
Surprised 0.5%
Angry 0.5%
Disgusted 0.4%
Fear 0.2%

AWS Rekognition

Age 4-12
Gender Female, 98.3%
Happy 73%
Calm 25.8%
Angry 0.3%
Disgusted 0.3%
Confused 0.3%
Sad 0.3%
Surprised 0.1%
Fear 0.1%

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 5
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.6%
Staircase 58.1%

Captions

Microsoft

a person standing next to a fence 67.4%
a person standing in front of a fence 67.3%
a person standing in front of a mirror posing for the camera 61.6%