Human Generated Data

Title

Untitled (seated man with three boys)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8850
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (seated man with three boys)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8850

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Clothing 99.4
Apparel 99.4
Person 97.8
Human 97.8
Person 97.1
Person 96.3
Dress 91.8
Guitar 91.5
Musical Instrument 91.5
Leisure Activities 91.5
Person 89.4
Female 88.4
Face 88.3
Costume 87.3
Icing 84.8
Food 84.8
Dessert 84.8
Cake 84.8
Cream 84.8
Creme 84.8
Girl 77.2
Plant 73.1
Kid 70.7
Child 70.7
Portrait 70.5
Photography 70.5
Photo 70.5
People 66.9
Woman 65.2
Person 62
Door 61.1
Hat 60.2
Sculpture 59.7
Art 59.7
Amusement Park 56.5
Play 56.4
Theme Park 56.1
Furniture 55.9
Indoors 55.6
Statue 55.1
Flower 55
Blossom 55

Clarifai
created on 2023-10-26

people 99.7
wedding 99.2
two 98
groom 97.4
woman 96.4
bride 95.2
veil 95
adult 93.6
group 93.6
three 92.7
monochrome 92.5
man 92.3
love 91.8
actress 90.7
ceremony 90.1
child 87.9
flower arrangement 87.7
celebration 85.8
facial expression 83.3
leader 83

Imagga
created on 2022-01-15

stringed instrument 82
banjo 77.2
musical instrument 64.8
guitar 53.7
music 46.1
musician 43.6
instrument 35.6
musical 31.6
play 30.1
playing 29.2
person 29.1
man 25.5
guitarist 24.6
performer 24.4
rock 24.3
adult 23.9
people 23.4
singer 23.1
male 22.7
bass 21.2
acoustic 20.6
sitar 19
sound 17.8
song 17.6
concert 17.5
performance 17.2
smile 17.1
player 17
electric 16.8
entertainment 15.6
band 15.5
black 14.4
fashion 14.3
portrait 14.2
studio 13.7
happiness 13.3
clothing 13.2
happy 13.2
artist 12.5
jeans 12.4
guy 12
human 12
old 11.8
melody 11.7
string 11.6
lifestyle 11.6
holding 11.5
roll 11.4
senior 11.2
fun 11.2
attractive 11.2
style 11.1
hair 11.1
model 10.9
device 10.9
hand 10.6
sexy 10.4
art 10.4
youth 10.2
smiling 10.1
jazz 9.8
cheerful 9.7
entertainer 9.7
men 9.4
joy 9.2
modern 9.1
pretty 9.1
rocker 8.9
blues 8.8
singing 8.8
hat 8.8
pop 8.7
expression 8.5
face 8.5
casual 8.5
handsome 8
patient 8
medical 7.9
women 7.9
sing 7.9
nurse 7.7
grunge 7.7
dance 7.6
dark 7.5
event 7.4
star 7.3
dress 7.2

Google
created on 2022-01-15

Photograph 94.1
Plant 91
Black 89.8
Black-and-white 86.7
Style 84
Monochrome 78.1
Monochrome photography 77.7
Snapshot 74.3
Art 72.7
Terrestrial plant 71.7
Room 71.7
Petal 68.4
Stock photography 65.2
Still life photography 57.9
Photographic paper 57.8
Flower 55.9
Vintage clothing 54.7
Illustration 54.3
Font 53.3
Rectangle 52.4

Microsoft
created on 2022-01-15

text 98.8
clothing 90.3
person 89.1
musical instrument 74.1
black and white 69.7
human face 66.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Female, 94.2%
Calm 77.4%
Sad 16.6%
Surprised 2.7%
Angry 1.2%
Disgusted 0.7%
Confused 0.7%
Fear 0.3%
Happy 0.3%

AWS Rekognition

Age 22-30
Gender Male, 60.1%
Sad 97.2%
Calm 2.6%
Happy 0.1%
Angry 0%
Confused 0%
Fear 0%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 16-24
Gender Female, 81%
Happy 68.5%
Calm 24.7%
Fear 2.9%
Surprised 1.3%
Sad 1%
Angry 0.6%
Disgusted 0.6%
Confused 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.8%
Guitar 91.5%

Categories

Imagga

paintings art 55.5%
people portraits 39%
streetview architecture 4%

Captions

Microsoft
created on 2022-01-15

a man and a woman in a wedding dress 41.3%

Text analysis

Amazon

39495
KODAK--AETW