Human Generated Data

Title

Self-Portrait with Sister, Milwaukee [Edward and Lillian Steichen]
Date

1900, printed later
People

Artist: Edward Steichen, American 1879 - 1973
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1985.11.2
Copyright

© The Estate of Edward Steichen / Artists Rights Society (ARS), New York

Human Generated Data

Title

Self-Portrait with Sister, Milwaukee [Edward and Lillian Steichen]

People

Artist: Edward Steichen, American 1879 - 1973

Date

1900, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1985.11.2

Copyright

© The Estate of Edward Steichen / Artists Rights Society (ARS), New York

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Clothing 100
Apparel 100
Person 98.1
Human 98.1
Person 96.6
Hat 94.5
Overcoat 93
Suit 93
Coat 93
Sun Hat 92.5
Cowboy Hat 83.2
Tie 71
Accessories 71
Accessory 71
Art 64.2
Collage 56.9
Advertisement 56.9
Poster 56.9

Clarifai
created on 2023-10-26

people 98.8
portrait 98.5
man 97.1
veil 94.5
wedding 93
paper 92.9
retro 92
adult 91.1
lid 90.8
vintage 90.4
art 89.1
monochrome 88.7
family 88.4
wear 87.1
sepia 86.9
old 86.5
woman 86.4
bill 84.2
bride 84.2
two 84.1

Imagga
created on 2022-01-09

container 54
envelope 49.4
paper 30.8
gift 30.1
box 29.8
ribbon 25.8
object 22
present 21.8
package 20.7
birthday 19.5
celebration 19.2
bow 19
shopping 18.8
holiday 16.5
bag 16.3
symbol 15.5
decoration 15.3
blank 14.3
surprise 14.1
valentine 13.6
money 13.6
love 12.6
design 12.4
empty 12.1
sign 12
packaging 11.7
business 11.5
single 11.5
currency 10.8
card 10.8
giving 10.6
retail 10.5
shiny 10.3
wrapping 9.9
gold 9.9
new 9.7
party 9.5
wealth 9
color 8.9
give 8.8
recycle 8.7
occasion 8.7
close 8.6
nobody 8.6
anniversary 8.5
finance 8.5
black 8.4
greeting 8.4
sale 8.3
bank 8.3
cash 8.2
lingerie 7.7
shape 7.4
wedding 7.4
note 7.4
office 7.2
hamper 7.2
silver 7.1
modern 7

Google
created on 2022-01-09

Hat 93.3
Picture frame 92.6
Coat 90.7
Gesture 85.3
Collar 84
Art 83.9
Headgear 82.9
Fedora 81.5
Suit 80.2
Blazer 77.6
Font 76.3
Vintage clothing 73.8
Rectangle 73.3
Painting 72.2
Formal wear 68.9
Visual arts 66.2
Paper product 64.6
Illustration 62.4
Paper 62.2
Monochrome photography 61.9

Microsoft
created on 2022-01-09

man 93.8
person 92.6
human face 91.2
clothing 87.8
text 84.6
gallery 73.2
room 44.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-35
Gender Male, 100%
Calm 85.7%
Sad 10.9%
Confused 1.4%
Angry 1.3%
Surprised 0.3%
Disgusted 0.2%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 21-29
Gender Female, 96.2%
Calm 99.8%
Sad 0.2%
Angry 0%
Happy 0%
Surprised 0%
Disgusted 0%
Confused 0%
Fear 0%

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%
Hat 94.5%
Suit 93%
Tie 71%

Categories

Imagga

paintings art 100%

Captions

Microsoft
created on 2022-01-09

an old photo of a person 42.3%
old photo of a person 38.5%
a photo of a person 38.4%