Human Generated Data

Title

Ben Shahn (1898-1969) and Dorothea Lange (1895-1965), Roosevelt, New Jersey
Date

June 1964
People

Artist: Sol Libsohn, American 1914 - 2001
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1973.72

Human Generated Data

Title

Ben Shahn (1898-1969) and Dorothea Lange (1895-1965), Roosevelt, New Jersey

People

Artist: Sol Libsohn, American 1914 - 2001

Date

June 1964

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1973.72

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Furniture 99.9
Sitting 99.4
Human 99.4
Restaurant 99.2
Table 97.9
Person 97.4
Person 96.7
Cafe 95
Chair 94.9
Tablecloth 87.9
Chair 86
Tabletop 85.2
Clothing 78.3
Apparel 78.3
Cafeteria 75.7
Home Decor 68.2
Sleeve 64.7
Dining Table 63.8
Meal 63.8
Food 63.8
Portrait 62.8
Photography 62.8
Face 62.8
Photo 62.8
Female 60.6
Shoe 59
Footwear 59
Dining Room 56.8
Indoors 56.8
Room 56.8
Food Court 55.5
Dating 55.1
Shoe 52.8

Clarifai
created on 2023-10-26

people 99.9
furniture 98.8
chair 98.7
adult 98.7
seat 96.8
man 96.5
two 96.4
woman 95.1
sit 94.1
elderly 92.8
table 90.8
recreation 89.4
group together 88.4
monochrome 88.2
one 87.4
group 85.1
portrait 84.9
three 82.5
room 81
street 80.6

Imagga
created on 2022-01-22

room 40
chair 37.7
musical instrument 36.5
table 35.5
man 29.6
classroom 29.2
male 27.7
person 25.2
people 25.1
teacher 24.8
percussion instrument 24.6
marimba 21.4
sitting 20.6
business 20
interior 19.5
office 18.6
meeting 17
men 16.3
home 15.9
lifestyle 15.9
adult 15.7
couple 15.7
group 15.3
businessman 15
work 14.2
modern 14
stringed instrument 13.9
corporate 13.7
glass 13.2
indoors 13.2
restaurant 13.2
happy 13.2
together 13.1
professional 13.1
team 12.5
house 12.5
laptop 12.5
educator 12.5
desk 12.3
businesswoman 11.8
communication 11.8
furniture 11.4
device 11.2
women 11.1
board 10.8
computer 10.7
smile 10.7
worker 10.5
education 10.4
love 10.3
smiling 10.1
drink 10
cheerful 9.8
job 9.7
working 9.7
executive 9.7
outdoors 9.7
class 9.6
seat 9.6
elderly 9.6
student 9.5
wind instrument 9.4
mature 9.3
floor 9.3
coffee 9.3
relaxation 9.2
inside 9.2
indoor 9.1
silhouette 9.1
old 9.1
family 8.9
chairs 8.8
boy 8.7
day 8.6
happiness 8.6
hall 8.6
learning 8.4
senior 8.4
teamwork 8.3
wine 8.3
technology 8.2
suit 8.1
success 8
design 7.9
urban 7.9
conference 7.8
life 7.7
reading 7.6
talking 7.6
pen 7.5
wood 7.5
leisure 7.5
study 7.5
manager 7.4
occupation 7.3
oboe 7.3
grandfather 7.3
meal 7.3
relaxing 7.3
black 7.2
handsome 7.1
portrait 7.1

Google
created on 2022-01-22

Table 96.2
Furniture 93.6
Chair 89.8
Black-and-white 86.2
Tableware 86.2
Style 84
Coffee table 78.9
Window 77
Sharing 76.2
Monochrome 74.7
Monochrome photography 73.7
Building 73.7
Sitting 70.9
Conversation 69.9
Outdoor table 69.1
Recreation 67.6
Desk 66.1
Art 64.8
Room 63
House 62.4

Microsoft
created on 2022-01-22

sitting 99
person 94.6
table 94.5
black and white 94.4
laptop 93.3
furniture 93.3
chair 88.7
indoor 87.8
man 80.1
clothing 79.2
restaurant 16.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 56-64
Gender Male, 100%
Happy 68%
Surprised 13.9%
Calm 9.8%
Confused 3.3%
Sad 1.9%
Angry 1.8%
Disgusted 0.7%
Fear 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.4%
Chair 94.9%
Dining Table 63.8%
Shoe 59%