Human Generated Data

Title

Self-Portrait with Sister, Milwaukee [Edward and Lillian Steichen]

Date

1900, printed later

People

Artist: Edward Steichen, American 1879 - 1973

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1985.11.2

Copyright

© The Estate of Edward Steichen / Artists Rights Society (ARS), New York

Human Generated Data

Title

Self-Portrait with Sister, Milwaukee [Edward and Lillian Steichen]

People

Artist: Edward Steichen, American 1879 - 1973

Date

1900, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Clothing 100
Apparel 100
Person 98.1
Human 98.1
Person 96.6
Hat 94.5
Overcoat 93
Suit 93
Coat 93
Sun Hat 92.5
Cowboy Hat 83.2
Accessory 71
Accessories 71
Tie 71
Art 64.2
Collage 56.9
Poster 56.9
Advertisement 56.9

Imagga
created on 2022-01-09

container 54
envelope 49.4
paper 30.8
gift 30.1
box 29.8
ribbon 25.8
object 22
present 21.8
package 20.7
birthday 19.5
celebration 19.2
bow 19
shopping 18.8
holiday 16.5
bag 16.3
symbol 15.5
decoration 15.3
blank 14.3
surprise 14.1
valentine 13.6
money 13.6
love 12.6
design 12.4
empty 12.1
sign 12
packaging 11.7
business 11.5
single 11.5
currency 10.8
card 10.8
giving 10.6
retail 10.5
shiny 10.3
wrapping 9.9
gold 9.9
new 9.7
party 9.5
wealth 9
color 8.9
give 8.8
recycle 8.7
occasion 8.7
close 8.6
nobody 8.6
anniversary 8.5
finance 8.5
black 8.4
greeting 8.4
sale 8.3
bank 8.3
cash 8.2
lingerie 7.7
shape 7.4
wedding 7.4
note 7.4
office 7.2
hamper 7.2
silver 7.1
modern 7

Google
created on 2022-01-09

Hat 93.3
Picture frame 92.6
Coat 90.7
Gesture 85.3
Collar 84
Art 83.9
Headgear 82.9
Fedora 81.5
Suit 80.2
Blazer 77.6
Font 76.3
Vintage clothing 73.8
Rectangle 73.3
Painting 72.2
Formal wear 68.9
Visual arts 66.2
Paper product 64.6
Illustration 62.4
Paper 62.2
Monochrome photography 61.9

Microsoft
created on 2022-01-09

man 93.8
person 92.6
human face 91.2
clothing 87.8
text 84.6
gallery 73.2
room 44.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-35
Gender Male, 100%
Calm 85.7%
Sad 10.9%
Confused 1.4%
Angry 1.3%
Surprised 0.3%
Disgusted 0.2%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 21-29
Gender Female, 96.2%
Calm 99.8%
Sad 0.2%
Angry 0%
Happy 0%
Surprised 0%
Disgusted 0%
Confused 0%
Fear 0%

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%
Hat 94.5%
Suit 93%
Tie 71%

Captions

Microsoft

an old photo of a person 42.3%
old photo of a person 38.5%
a photo of a person 38.4%