Human Generated Data

Title

Untitled (four girls playing "GOBI", Lido Beach, FL)

Date

1949

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5375

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (four girls playing "GOBI", Lido Beach, FL)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1949

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Human 99.8
Person 99.8
Furniture 99.3
Person 99
Person 98.5
Person 97.9
Chair 85.7
Female 79.7
Table 74
Girl 67.9
Clothing 66.8
Apparel 66.8
People 62.2
Desk 61.6
Indoors 60.9
Room 58.7
Wood 58.6
Flooring 56.9
Bed 55.8

Imagga
created on 2022-01-28

table 79.9
desk 66.2
furniture 61.6
room 46.2
interior 44.2
furnishing 29.7
modern 29.4
home 28.8
indoors 28.1
house 25.9
indoor 21.9
luxury 21.4
office 21.4
chair 21.3
decor 18.6
design 18
lifestyle 17.3
people 16.7
business 16.4
apartment 16.3
computer 15.4
glass 14.9
inside 14.7
architecture 14.3
adult 13.8
window 13.7
kitchen 13.6
person 13.4
laptop 13.1
dining table 12.9
work 12.7
dishwasher 12.2
light 12
domestic 11.8
working 11.5
businessman 11.5
dining 11.4
professional 11.3
floor 11.2
restaurant 11.1
color 11.1
casual 11
man 10.9
male 10.6
job 10.6
tabletop 10.5
classroom 10.5
contemporary 10.3
appliance 10.3
wall 10.3
tile 10.2
service 10.2
executive 10.1
decoration 10.1
nobody 10.1
3d 10.1
drink 10
clean 10
wood 10
businesswoman 10
faucet 9.8
worker 9.8
metal 9.7
building 9.6
comfortable 9.5
white goods 9.5
paper 9.5
meeting 9.4
hall 9.4
new 8.9
sink 8.8
home appliance 8.7
day 8.6
corporate 8.6
empty 8.6
men 8.6
lamp 8.6
businesspeople 8.5
space 8.5
horizontal 8.4
structure 8.3
occupation 8.2
style 8.2
seat 8.1
team 8.1
bathroom 8
cabinet 8
steel 8
vase 7.9
women 7.9
library 7.9
conference 7.8
ceramic 7.7
1 7.7
elegant 7.7
sofa 7.7
hotel 7.6
workplace 7.6
living 7.6
happy 7.5
one 7.5
alone 7.3
group 7.3
counter 7.2
clothing 7.2
bright 7.1
portrait 7.1
face 7.1

Google
created on 2022-01-28

Table 92.3
Black-and-white 85
Style 83.8
Brassiere 83.8
Swimwear 81.7
Desk 76.8
Art 75.8
Monochrome photography 74.6
Chair 74.6
Monochrome 73.9
Thigh 72.9
Vintage clothing 71.2
Event 68.7
Suit 68.6
Fun 67.2
Room 66.7
Human leg 66.4
Indoor games and sports 65.6
Sitting 64
Games 63.1

Microsoft
created on 2022-01-28

table 98.7
text 98.5
furniture 97.7
chair 88.9
laptop 86.5
black and white 84.7
coffee table 72.2
house 70.4
wedding 54.2

Face analysis

Amazon

Google

AWS Rekognition

Age 33-41
Gender Male, 66.9%
Sad 50.6%
Calm 36.7%
Confused 3.5%
Happy 3%
Disgusted 2.7%
Surprised 1.4%
Angry 1.3%
Fear 0.8%

AWS Rekognition

Age 27-37
Gender Female, 87.2%
Calm 96.5%
Happy 1.4%
Confused 1.1%
Surprised 0.4%
Sad 0.2%
Disgusted 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 27-37
Gender Female, 98.6%
Happy 99.5%
Calm 0.3%
Disgusted 0%
Sad 0%
Confused 0%
Fear 0%
Surprised 0%
Angry 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a group of people sitting at a table 89.8%
a group of people sitting at a table with a laptop 84.4%
a group of people sitting around a table 84.3%

Text analysis

Amazon

STEINMETZ,
SARASOTA,
STEINMETZ, SARASOTA, FLORIDA
FLORIDA
GOBI
26891
CAVIS

Google

GOBI
SARASOTA,
FLORIDA
26871
STEINMETZ,
GOBI 26871 STEINMETZ, SARASOTA, FLORIDA