Human Generated Data

Title

Untitled (men and women gathered in a dining room)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4596
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men and women gathered in a dining room)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4596

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Person 99.2
Human 99.2
Person 99.1
Person 98.5
Sitting 98.4
Person 97.9
Person 97
Person 96.1
Person 94.7
Person 93.6
Chair 93.4
Furniture 93.4
Person 90.8
Clothing 89.7
Apparel 89.7
Person 89.6
Person 89.1
Flooring 88.6
Person 88
Person 87.6
Crowd 85.6
Couch 81.8
Suit 78.9
Overcoat 78.9
Coat 78.9
Person 75.5
Person 73.1
Wood 73
Living Room 71.9
Indoors 71.9
Room 71.9
Audience 69.2
Chair 67.9
People 63.7
Plant 62.5
Floor 56.9
Chair 55.1

Clarifai
created on 2023-10-29

people 98.8
restaurant 97.5
chair 96.4
woman 96.3
man 96.1
group 95.3
bar 94.1
dining 93.5
table 92.9
hotel 92.7
adult 92.1
indoors 90.4
wine 88.2
girl 87.6
room 86.7
meeting 86.2
seat 84.7
family 84.4
furniture 83.8
pub 83.2

Imagga
created on 2022-02-05

room 45.3
table 41.7
teacher 38.3
classroom 35.6
interior 32.7
person 28.7
chair 27.6
people 25.7
meeting 23.6
man 23.5
group 23.4
home 23.1
professional 22.3
indoors 21.1
sitting 20.6
office 20.6
male 19.9
educator 19.8
smiling 19.5
desk 19
modern 18.9
restaurant 18.7
business 18.2
furniture 18.2
team 17.9
businessman 17.7
house 17.6
education 17.3
student 16.9
adult 16.5
together 15.8
indoor 15.5
women 15
outfit 14.6
businesswoman 14.5
executive 14.2
teamwork 13.9
happy 13.8
corporate 13.8
men 13.7
lifestyle 13.7
conference 13.7
communication 13.4
work 13.4
design 13
smile 12.8
school 12.4
dining 12.4
contemporary 12.2
musical instrument 12
inside 12
laptop 11.9
suit 11.7
bowed stringed instrument 11.6
class 11.6
kid 11.5
working 11.5
learning 11.3
success 11.3
presentation 11.2
empty 11.2
board 10.9
stringed instrument 10.9
chairs 10.8
workplace 10.5
talking 10.5
showing 10.3
hall 10.3
coffee 10.2
happiness 10.2
occupation 10.1
teaching 9.7
computer 9.6
child 9.4
light 9.4
glass 9.3
study 9.3
children 9.1
kitchen 8.9
family 8.9
decor 8.8
cafeteria 8.8
center 8.7
boy 8.7
gesture 8.6
businesspeople 8.5
life 8.5
food 8.5
color 8.3
holding 8.3
singer 8.2
cheerful 8.1
to 8
wooden 7.9
seat 7.8
students 7.8
director 7.7
living 7.6
sit 7.6
togetherness 7.6
friends 7.5
wood 7.5
musician 7.5
friendship 7.5
manager 7.5
looking 7.2

Google
created on 2022-02-05

Furniture 94.7
Table 94.4
Picture frame 90.8
Chair 90.3
Lighting 86.7
Couch 84.8
Houseplant 80.3
Art 75.5
Suit 74.7
Event 74.2
Conversation 68.7
Room 68.6
Coffee table 67.5
Stock photography 62.5
Sitting 62.1
Exhibition 60.1
Collaboration 59.5
Visual arts 58.6
Fun 56
Monochrome photography 55.9

Microsoft
created on 2022-02-05

indoor 99.6
wall 97.7
furniture 97.3
ceiling 95
clothing 94.2
table 92.5
floor 91.2
chair 91.2
text 88.2
person 86.6
room 83.8
woman 73.1
footwear 68.2
man 66.7
people 57.4
couch 53.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 4-12
Gender Male, 99.5%
Calm 95.3%
Happy 1.4%
Angry 0.9%
Surprised 0.6%
Disgusted 0.5%
Sad 0.4%
Fear 0.4%
Confused 0.4%

AWS Rekognition

Age 49-57
Gender Male, 99.9%
Calm 36.9%
Surprised 15%
Sad 13.4%
Confused 13%
Disgusted 7.2%
Happy 5.5%
Angry 5.5%
Fear 3.6%

AWS Rekognition

Age 54-62
Gender Male, 99.9%
Sad 80%
Disgusted 6.4%
Happy 4.3%
Calm 2.4%
Surprised 1.9%
Angry 1.8%
Confused 1.7%
Fear 1.4%

AWS Rekognition

Age 12-20
Gender Female, 58.4%
Sad 62.8%
Fear 15.4%
Calm 11.5%
Confused 4.2%
Happy 3.6%
Angry 0.9%
Disgusted 0.9%
Surprised 0.7%

AWS Rekognition

Age 52-60
Gender Female, 95.2%
Calm 64.3%
Disgusted 18%
Happy 7.7%
Sad 5.1%
Confused 1.7%
Angry 1.6%
Surprised 1.1%
Fear 0.6%

AWS Rekognition

Age 27-37
Gender Female, 99.6%
Sad 76.7%
Happy 10.5%
Calm 7%
Fear 2.9%
Disgusted 1.8%
Angry 0.5%
Surprised 0.4%
Confused 0.3%

AWS Rekognition

Age 56-64
Gender Male, 99.8%
Disgusted 48.5%
Calm 39.7%
Angry 4.1%
Sad 2.2%
Happy 1.9%
Surprised 1.9%
Confused 0.9%
Fear 0.8%

AWS Rekognition

Age 39-47
Gender Female, 99.6%
Surprised 89%
Sad 8.9%
Calm 0.9%
Disgusted 0.3%
Confused 0.3%
Angry 0.2%
Fear 0.2%
Happy 0.2%

AWS Rekognition

Age 50-58
Gender Male, 100%
Sad 79.5%
Confused 16.5%
Disgusted 1.7%
Calm 1.2%
Surprised 0.6%
Fear 0.2%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 28-38
Gender Female, 99.7%
Disgusted 56%
Sad 17.6%
Happy 11.5%
Surprised 6.5%
Calm 3.2%
Angry 3.2%
Fear 1.4%
Confused 0.6%

AWS Rekognition

Age 47-53
Gender Male, 99.9%
Calm 69.6%
Sad 16.4%
Disgusted 6.9%
Surprised 3.1%
Angry 1.3%
Confused 1.2%
Happy 0.9%
Fear 0.6%

AWS Rekognition

Age 23-33
Gender Female, 60.7%
Happy 89.6%
Surprised 3.1%
Sad 2.2%
Fear 1.8%
Calm 1.3%
Disgusted 1.1%
Angry 0.7%
Confused 0.3%

AWS Rekognition

Age 36-44
Gender Male, 99.4%
Sad 91.8%
Disgusted 2.8%
Happy 1.7%
Angry 1.2%
Fear 0.8%
Calm 0.7%
Confused 0.6%
Surprised 0.5%

AWS Rekognition

Age 28-38
Gender Female, 88.8%
Fear 52.4%
Calm 31.7%
Sad 5.9%
Angry 4.8%
Happy 1.8%
Disgusted 1.6%
Surprised 1.1%
Confused 0.7%

AWS Rekognition

Age 25-35
Gender Female, 98.1%
Calm 81.8%
Sad 8.7%
Happy 3.4%
Angry 2.4%
Fear 1.5%
Disgusted 0.8%
Confused 0.7%
Surprised 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person
Chair
Person 99.2%
Person 99.1%
Person 98.5%
Person 97.9%
Person 97%
Person 96.1%
Person 94.7%
Person 93.6%
Person 90.8%
Person 89.6%
Person 89.1%
Person 88%
Person 87.6%
Person 75.5%
Person 73.1%
Chair 93.4%
Chair 67.9%
Chair 55.1%

Categories

Imagga

events parties 98.6%

Text analysis

Amazon

FLORIDA
STEINMETZ,
SOA
STEINMETZ, SARASOTA, FLORIDA
SARASOTA,
KOOK SOA
KOOK

Google

STEINMETZ, SARASOTA. FLORIDA EAME -YT37A°2 XAQON SOA
STEINMETZ,
SARASOTA.
FLORIDA
EAME
-YT37A°2
XAQON
SOA