Human Generated Data

Title

Untitled (man and woman sitting on lawn chairs with dog)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8826
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man and woman sitting on lawn chairs with dog)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.4
Human 99.4
Person 99.1
Tree 97.4
Plant 97.4
Clothing 96.4
Apparel 96.4
Palm Tree 93.4
Arecaceae 93.4
Furniture 93.3
Chair 93
Dog 92.3
Mammal 92.3
Animal 92.3
Canine 92.3
Pet 92.3
Dress 91.2
Grass 90.5
Female 84.7
Outdoors 81.7
Nature 76.9
Face 76.4
Sitting 76
Woman 75.1
Vegetation 72.7
People 70.5
Yard 67.6
Meal 65.6
Food 65.6
Portrait 65.4
Photography 65.4
Photo 65.4
Leisure Activities 61.9
Couch 61.5
Girl 60.6
Suit 59.8
Coat 59.8
Overcoat 59.8
Housing 59.1
Building 59.1
Costume 57.9
Robe 57.6
Fashion 57.6
Gown 56.3

Imagga
created on 2022-01-09

stadium 40.9
crowd 40.3
silhouette 39.7
cheering 39.2
audience 39
patriotic 38.3
nighttime 38.2
nation 37.9
lights 37.1
flag 36.7
people 32.3
icon 31.7
symbol 31
person 29.9
vibrant 23.6
sport 22.2
field 21.7
player 21.7
chair 21.7
championship 21.4
match 21.2
skill 21.2
muscular 21
athlete 20.8
design 20.8
bright 20.7
event 20.3
training 20.3
competition 20.1
man 19.5
seat 19.3
park 18.9
team 18.8
versus 18.7
shorts 18.6
vivid 18.6
male 17.7
businessman 16.8
teamwork 16.7
piano 16.4
boss 16.3
president 15.7
leader 15.4
sexy 15.3
job 15
furniture 14.9
supporters 14.8
speech 14.7
presentation 14
occupation 13.7
businesswoman 13.6
grand piano 13.5
room 13.5
business 13.4
stringed instrument 12.8
work 12.7
percussion instrument 12.6
keyboard instrument 12.6
dangerous 12.4
ring 12.3
window 12
against 11.9
uppercut 11.9
jab 11.9
ropes 11.8
punch 11.8
boxing 11.7
musical instrument 11.7
gloves 11.6
fight 11.6
block 11.5
glowing 11.1
shiny 11.1
interior 10.6
black 10.2
table 9.7
cross 9.4
structure 9
group 8.9
boxer 8.8
indoors 8.8
glass 8.6
indoor 8.2
rocking chair 8.1
sun 8
home 8
architecture 7.9
couple 7.8
serve 7.8
hall 7.7
fashion 7.5
floor 7.4
document 7.4
water 7.3
cemetery 7.3
star 7.2
love 7.1
summer 7.1
modern 7

Google
created on 2022-01-09

Photograph 94.2
Plant 92.1
Black-and-white 86.7
Dress 86.4
Window 86
Chair 85.2
Style 84
Tree 81.5
Adaptation 79.4
Font 78.3
Monochrome 77.2
Monochrome photography 76.7
Snapshot 74.3
Suit 73.3
Room 70.8
Art 69.3
Couch 69.2
Arecales 69
Palm tree 68.1
Photo caption 68

Microsoft
created on 2022-01-09

text 99.5
outdoor 91.5
black and white 54.3

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Female, 95.8%
Happy 97.4%
Calm 0.9%
Sad 0.7%
Fear 0.3%
Surprised 0.3%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Dog 92.3%

Captions

Microsoft

a group of people sitting in front of a building 61.9%
a person sitting in front of a building 53.2%
a person sitting in front of a building 53.1%

Text analysis

Amazon

39493
STA
KODAKEEEIA

Google

STA YT37A°2- AGO
STA
YT37A°2-
AGO