Human Generated Data

Title

Untitled (children posing on staircase)

Date

1965

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16774

Human Generated Data

Title

Untitled (children posing on staircase)

People

Artist: Lucian and Mary Brown, American

Date

1965

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Handrail 100
Banister 100
Person 99.6
Human 99.6
Person 99.6
Railing 99.5
Person 99.2
Person 99
Person 94.8
Clothing 86.7
Apparel 86.7
Person 79.9
Female 77.1
Sleeve 63.1
Suit 61.4
Coat 61.4
Overcoat 61.4
Housing 60.4
Building 60.4
Staircase 59.6
Face 58.3
Woman 57.6
Girl 55.3

Imagga
created on 2022-02-26

structure 33.6
building 32.2
architecture 24.6
balcony 22.8
shop 20.5
wall 20.5
modern 20.3
window 18.8
city 18.3
old 17.4
mercantile establishment 16.8
billboard 16.8
house 16.7
urban 16.6
business 16.4
signboard 16.2
construction 14.5
finance 13.5
bakery 12.8
glass 12.4
vintage 12.4
grunge 11.9
art 11.8
design 11.2
ancient 11.2
technology 11.1
place of business 11.1
exterior 11.1
facade 11
financial 10.7
texture 10.4
black 10.2
street 10.1
retro 9.8
interior 9.7
digital 9.7
pattern 9.6
industry 9.4
town 9.3
cinema 9
home 8.8
graphic 8.8
high 8.7
lamp 8.6
3d 8.5
travel 8.4
sky 8.3
success 8
board 8
brick 7.8
office 7.7
chart 7.6
barbershop 7.6
buildings 7.6
frame 7.5
new 7.3
metal 7.2
aged 7.2
dirty 7.2
negative 7.2
barrier 7.1

Google
created on 2022-02-26

Black 89.5
Black-and-white 87
Style 84
Door 81.4
Monochrome 78.8
Monochrome photography 78.5
Suit 76.4
Stairs 76
Art 75.1
Handrail 68.8
Street 68.8
Event 68.7
Metal 68
Room 64.8
Stock photography 63.6
City 58
Fence 57.6
Font 56.6
Visual arts 54.1
Hat 53.4

Microsoft
created on 2022-02-26

person 98.8
text 94.5
black and white 88
stairs 85.6
clothing 75.8
man 60.8
line 18.3

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Male, 99.7%
Surprised 35.3%
Calm 24.1%
Confused 23.6%
Disgusted 6.8%
Happy 5.9%
Sad 1.7%
Angry 1.6%
Fear 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people standing in front of a building 91.5%
a group of people standing in front of a store 83.7%
a group of people that are standing in front of a building 83.6%

Text analysis

Amazon

3
KODAKA-

Google

gON
MJIA--YT3A-
-A
MJIA--YT3A- -A gON