Human Generated Data

Title

Untitled (seated man with three boys)

Date

c. 1950

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8850

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (seated man with three boys)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Clothing 99.4
Apparel 99.4
Person 97.8
Human 97.8
Person 97.1
Person 96.3
Dress 91.8
Leisure Activities 91.5
Musical Instrument 91.5
Guitar 91.5
Person 89.4
Female 88.4
Face 88.3
Costume 87.3
Creme 84.8
Icing 84.8
Cake 84.8
Food 84.8
Dessert 84.8
Cream 84.8
Girl 77.2
Plant 73.1
Kid 70.7
Child 70.7
Portrait 70.5
Photo 70.5
Photography 70.5
People 66.9
Woman 65.2
Person 62
Door 61.1
Hat 60.2
Art 59.7
Sculpture 59.7
Amusement Park 56.5
Play 56.4
Theme Park 56.1
Furniture 55.9
Indoors 55.6
Statue 55.1
Flower 55
Blossom 55

Imagga
created on 2022-01-15

stringed instrument 82
banjo 77.2
musical instrument 64.8
guitar 53.7
music 46.1
musician 43.6
instrument 35.6
musical 31.6
play 30.1
playing 29.2
person 29.1
man 25.5
guitarist 24.6
performer 24.4
rock 24.3
adult 23.9
people 23.4
singer 23.1
male 22.7
bass 21.2
acoustic 20.6
sitar 19
sound 17.8
song 17.6
concert 17.5
performance 17.2
smile 17.1
player 17
electric 16.8
entertainment 15.6
band 15.5
black 14.4
fashion 14.3
portrait 14.2
studio 13.7
happiness 13.3
clothing 13.2
happy 13.2
artist 12.5
jeans 12.4
guy 12
human 12
old 11.8
melody 11.7
string 11.6
lifestyle 11.6
holding 11.5
roll 11.4
senior 11.2
fun 11.2
attractive 11.2
style 11.1
hair 11.1
model 10.9
device 10.9
hand 10.6
sexy 10.4
art 10.4
youth 10.2
smiling 10.1
jazz 9.8
cheerful 9.7
entertainer 9.7
men 9.4
joy 9.2
modern 9.1
pretty 9.1
rocker 8.9
blues 8.8
singing 8.8
hat 8.8
pop 8.7
expression 8.5
face 8.5
casual 8.5
handsome 8
patient 8
medical 7.9
women 7.9
sing 7.9
nurse 7.7
grunge 7.7
dance 7.6
dark 7.5
event 7.4
star 7.3
dress 7.2

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Female, 94.2%
Calm 77.4%
Sad 16.6%
Surprised 2.7%
Angry 1.2%
Disgusted 0.7%
Confused 0.7%
Fear 0.3%
Happy 0.3%

AWS Rekognition

Age 22-30
Gender Male, 60.1%
Sad 97.2%
Calm 2.6%
Happy 0.1%
Angry 0%
Confused 0%
Fear 0%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 16-24
Gender Female, 81%
Happy 68.5%
Calm 24.7%
Fear 2.9%
Surprised 1.3%
Sad 1%
Angry 0.6%
Disgusted 0.6%
Confused 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.8%
Guitar 91.5%

Captions

Microsoft

a man and a woman in a wedding dress 41.3%

Text analysis

Amazon

39495
KODAK--AETW