Human Generated Data

Title

Untitled (Louis and Mama Pappas with sons in their restaurant with their famous Greek salad)
Date

1947
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5552
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Louis and Mama Pappas with sons in their restaurant with their famous Greek salad)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1947

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.4
Human 99.4
Person 99.3
Person 98.5
Person 97.6
Person 97.2
Clinic 94.7
Hospital 84
Operating Theatre 79.8
People 78.5
Clothing 66.8
Apparel 66.8
Face 59.3
Photo 59.3
Photography 59.3
Portrait 59.3
Food 56.4
Dessert 56.4
Cream 56.4
Cake 56.4
Icing 56.4
Creme 56.4
Person 56.3
Nurse 55.2

Imagga
created on 2022-01-23

people 39.6
man 36.3
senior 33.7
male 30.5
person 29.8
couple 29.6
adult 28.8
happy 24.4
elderly 22
women 21.3
nurse 21.1
men 20.6
smiling 20.3
mature 19.5
medical 19.4
negative 18.8
patient 18.6
together 18.4
professional 18.4
sitting 18
indoors 17.6
home 17.5
grandma 17.4
old 16.7
executive 16.3
portrait 15.5
health 15.3
team 15.2
film 14.8
business 14.6
retirement 14.4
doctor 14.1
worker 14
older 13.6
teacher 13.6
room 13.4
businessman 13.2
lifestyle 13
kin 12.9
smile 12.8
casual 12.7
love 12.6
hospital 12.6
happiness 12.5
office 12.2
camera 12
looking 12
two 11.9
work 11.8
60s 11.7
husband 11.6
working 11.5
photographic paper 11.4
illness 11.4
coat 11.3
clothing 11.1
lab coat 11.1
70s 10.8
surgeon 10.7
two people 10.7
family 10.7
medicine 10.6
human 10.5
group 10.5
meeting 10.4
day 10.2
teamwork 10.2
occupation 10.1
clinic 9.9
care 9.9
casual clothing 9.8
cheerful 9.8
retired 9.7
look 9.6
30s 9.6
married 9.6
wife 9.5
horizontal 9.2
20s 9.2
modern 9.1
aged 9
suit 9
lady 8.9
job 8.8
educator 8.8
table 8.7
talking 8.6
student 8.5
marriage 8.5
enjoying 8.5
adults 8.5
desk 8.5
attractive 8.4
color 8.3
holding 8.3
to 8
specialist 7.9
seniors 7.9
sixties 7.8
half length 7.8
education 7.8
laboratory 7.7
photographic equipment 7.6
hand 7.6
friends 7.5
friendship 7.5
life 7.4
indoor 7.3
handsome 7.1
face 7.1

Google
created on 2022-01-23

Sleeve 87.2
Standing 86.4
Smile 82.5
Apron 81.2
Vintage clothing 78
Snapshot 74.3
Monochrome photography 72.2
Event 71.6
Hat 70.8
Monochrome 69.6
Cooking 68.8
History 67.5
Classic 66.2
Stock photography 64.5
Font 63.9
Uniform 63.9
Room 63.5
Team 59.8
Window 59.2
Service 58.8

Microsoft
created on 2022-01-23

text 99.8
person 98.6
clothing 89.9
standing 77
posing 72.4
man 66.1
smile 65.5
black and white 57.2
sketch 52.1
drawing 51.5
old 42.8

Face analysis

Amazon

Google

AWS Rekognition

Age 39-47
Gender Male, 99.2%
Happy 42.8%
Surprised 31.5%
Calm 9%
Confused 7.7%
Disgusted 3.6%
Sad 3%
Angry 1.6%
Fear 0.9%

AWS Rekognition

Age 49-57
Gender Female, 94.3%
Calm 50.1%
Happy 23%
Sad 10.2%
Angry 6.7%
Surprised 5.9%
Disgusted 1.8%
Fear 1.6%
Confused 0.6%

AWS Rekognition

Age 54-64
Gender Female, 52.7%
Confused 64.4%
Sad 13.8%
Disgusted 10.4%
Calm 3.4%
Angry 2.5%
Fear 2.5%
Happy 1.8%
Surprised 1.2%

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Sad 38.6%
Calm 27.7%
Angry 17.9%
Surprised 7.9%
Disgusted 5%
Confused 1.2%
Happy 1%
Fear 0.8%

AWS Rekognition

Age 30-40
Gender Male, 57.7%
Happy 88.4%
Surprised 7.3%
Disgusted 1.4%
Sad 0.8%
Confused 0.7%
Fear 0.7%
Calm 0.4%
Angry 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a group of people posing for a photo 96.4%
a group of people posing for the camera 96.3%
a group of people posing for a picture 96.2%

Text analysis

Amazon

J.
KEY,
SIESTA
STEINMETZ,
22943.
J. J. STEINMETZ, SIESTA KEY, SARASOTA,-FLA.
SARASOTA,-FLA.

Google

22943.
22943. J. J. STEINMETZ, SIESTA KEY, SARASOTA,-FLA.
J.
KEY,
SIESTA
SARASOTA,-FLA.
STEINMETZ,