Human Generated Data

Title

Untitled (man showing snakes in jars to children)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4501
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man showing snakes in jars to children)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4501

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.8
Human 99.8
Person 99.3
Person 99.3
Person 98.3
Person 97.9
Person 96.4
Person 96.2
Person 96.1
Person 94
Person 91.2
Person 91
Meal 90.2
Food 90.2
Tabletop 89.8
Furniture 89.8
Face 89.6
Person 88.5
Person 87.9
Tie 87.8
Accessories 87.8
Accessory 87.8
Table 85.4
Drink 81.1
Beverage 81.1
Room 78.4
Indoors 78.4
Dining Table 75.7
Dish 72.3
Female 69.5
People 69.5
Person 65.8
Restaurant 65.4
Girl 60.2
Plant 58.8
Alcohol 58.6
Glass 58.3
Kid 57.3
Child 57.3

Clarifai
created on 2023-10-27

people 99.9
group 99.1
child 96.9
group together 95.8
woman 95.8
man 95.7
adult 95.7
many 94.7
education 89.2
administration 89.2
monochrome 88.9
teacher 86.1
boy 85.6
sit 83.7
several 81.7
indoors 81
war 79.6
family 78.1
crowd 77
leader 75.3

Imagga
created on 2022-01-23

senior 37.4
person 36.2
people 32.3
man 32.2
male 29
adult 27.7
kin 25.3
old 25
elderly 23.9
couple 23.5
brass 22.5
happy 20
mature 19.5
home 19.1
wind instrument 18.9
portrait 18.7
teacher 18.5
indoors 18.4
musical instrument 18.1
together 16.6
smiling 16.6
retired 16.5
planner 16.3
retirement 15.3
older 14.6
husband 14.3
grandma 14
sitting 13.7
room 13.6
love 13.4
aged 12.7
to 12.4
camera 12
looking 12
hair 11.9
casual 11.8
health 11.8
holding 11.5
professional 11.3
men 11.2
lifestyle 10.8
hand 10.6
cheerful 10.6
married 10.5
two 10.2
face 9.9
family 9.8
60s 9.8
human 9.7
medical 9.7
educator 9.7
education 9.5
wife 9.5
enjoying 9.5
day 9.4
happiness 9.4
smile 9.3
indoor 9.1
classroom 9.1
businessman 8.8
women 8.7
pensioner 8.5
business 8.5
meeting 8.5
patient 8.3
care 8.2
nurse 8.1
lady 8.1
handsome 8
hospital 8
grandfather 8
70s 7.9
seniors 7.8
grandmother 7.8
black 7.8
teaching 7.8
class 7.7
modern 7.7
bride 7.7
drinking 7.6
age 7.6
marriage 7.6
businesspeople 7.6
horizontal 7.5
drink 7.5
active 7.3
group 7.2
gray 7.2
romance 7.1
work 7.1
mother 7

Google
created on 2022-01-23

Black 89.8
Black-and-white 86.7
Style 84.1
Art 80.5
Adaptation 79.3
Monochrome 76.5
Shorts 75.9
T-shirt 75.7
Monochrome photography 75.6
Event 74
Vintage clothing 70.4
Room 68.6
Fun 68
Hat 64.4
Table 64.4
Stock photography 63.7
Visual arts 62.3
History 60.8
Team 58.9
Child 57.6

Microsoft
created on 2022-01-23

person 99.9
text 98.9
clothing 97.9
man 89.4
group 72.2
smile 69.2
woman 65.4
human face 52.8
posing 50.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Female, 51.8%
Calm 95.4%
Surprised 1.9%
Sad 1.4%
Fear 0.4%
Disgusted 0.4%
Confused 0.2%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 14-22
Gender Female, 56.5%
Sad 53.9%
Calm 33.4%
Happy 8.8%
Confused 1.8%
Angry 0.7%
Disgusted 0.6%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 24-34
Gender Female, 98.4%
Calm 87.1%
Sad 9.2%
Happy 1%
Angry 0.9%
Disgusted 0.7%
Surprised 0.4%
Fear 0.3%
Confused 0.3%

AWS Rekognition

Age 45-53
Gender Male, 69.7%
Calm 95.6%
Sad 1.9%
Happy 1%
Confused 0.6%
Disgusted 0.3%
Surprised 0.3%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 20-28
Gender Male, 74.6%
Sad 89.1%
Calm 8.2%
Happy 0.9%
Surprised 0.6%
Fear 0.4%
Disgusted 0.3%
Angry 0.2%
Confused 0.2%

AWS Rekognition

Age 30-40
Gender Male, 99%
Calm 55.8%
Sad 29.6%
Confused 4.7%
Disgusted 4.4%
Happy 2%
Surprised 1.6%
Angry 1.2%
Fear 0.8%

AWS Rekognition

Age 29-39
Gender Female, 76.6%
Calm 84.8%
Surprised 14%
Sad 0.5%
Disgusted 0.2%
Angry 0.2%
Fear 0.1%
Happy 0.1%
Confused 0.1%

AWS Rekognition

Age 27-37
Gender Female, 51.4%
Calm 98.4%
Sad 0.9%
Surprised 0.2%
Confused 0.1%
Disgusted 0.1%
Happy 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Male, 58.1%
Sad 90.5%
Calm 7.5%
Confused 1.5%
Disgusted 0.2%
Fear 0.1%
Happy 0.1%
Angry 0.1%
Surprised 0.1%

AWS Rekognition

Age 29-39
Gender Female, 54.9%
Calm 86%
Sad 9.6%
Surprised 3.3%
Angry 0.5%
Disgusted 0.2%
Confused 0.2%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 31-41
Gender Male, 99.6%
Calm 96.9%
Sad 2.2%
Surprised 0.3%
Confused 0.3%
Happy 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 27-37
Gender Female, 69.1%
Calm 98.8%
Sad 0.9%
Confused 0.1%
Surprised 0.1%
Happy 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 27-37
Gender Male, 99.8%
Calm 85.4%
Sad 10.9%
Surprised 1.4%
Happy 0.8%
Confused 0.5%
Disgusted 0.5%
Angry 0.4%
Fear 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Tie 87.8%

Categories

Imagga

people portraits 53.1%
paintings art 44.1%

Text analysis

Amazon

SIESTA
KEY,
J.
23461.
SARASOTA,
STEINMETZ,
J. J. STEINMETZ, SIESTA KEY, SARASOTA, FLA.
FLA.

Google

23461. J. J. STEINMETZ, SIESTA KEY, SARASOTA, FLA:
J.
SIESTA
FLA:
23461.
STEINMETZ,
KEY,
SARASOTA,