Human Generated Data

Title

Untitled (female students in library, Rivier College)
Date

c. 1938, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5755

Human Generated Data

Title

Untitled (female students in library, Rivier College)

People

Artist: Durette Studio, American 20th century

Date

c. 1938, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Chair 99.8
Furniture 99.8
Person 99.4
Human 99.4
Person 99.3
Chair 98.9
Restaurant 98.7
Person 97.4
Cafe 93.1
Cafeteria 90.2
Person 89.5
Person 85.4
Person 84.4
Workshop 84.2
Person 83.2
Shelf 81
Indoors 78.9
School 75.6
Person 75.2
Person 74.5
Room 72.9
Shop 67.7
Interior Design 66.3
Classroom 61.4
Wood 56.1
Clothing 55.6
Apparel 55.6

Clarifai
created on 2019-11-16

people 99.9
group together 99.4
many 99
furniture 98.9
group 98.6
room 98.1
chair 97
adult 96.9
man 96
woman 92.9
bar 91.6
administration 91.4
desk 90.7
seat 90.5
monochrome 89.8
leader 88.7
employee 88
war 87.7
indoors 87.6
crowd 87.3

Imagga
created on 2019-11-16

interior 52.2
restaurant 50
room 44.1
cafeteria 41.3
chair 37.7
counter 37.3
building 32.7
table 31.3
modern 30.8
furniture 27.1
shop 27
classroom 24
inside 23
house 22.6
shoe shop 22.5
floor 22.3
indoors 22
structure 21.7
dining 20.9
architecture 20.3
kitchen 19.8
design 19.7
mercantile establishment 18.8
wood 18.3
window 17.5
indoor 17.3
comfortable 17.2
glass 16.3
empty 16.3
light 16
home 15.9
decor 15.9
business 15.8
people 15.6
dinner 14.3
lamp 14.3
drink 14.2
contemporary 14.1
style 14.1
urban 14
food 13.9
tables 13.8
chairs 13.7
steel 13.3
place of business 13.1
luxury 12.9
stool 12.8
decoration 12.3
seat 12.2
center 12.1
stove 12.1
party 12
bar 12
plant 11.9
hall 11.7
office 11.6
elegance 10.9
stylish 10.8
city 10.8
wall 10.3
lights 10.2
service 10.2
silhouette 9.9
airport 9.8
hotel 9.5
men 9.4
work 9.4
place 9.3
3d 9.3
transportation 9
reflection 8.9
cabinets 8.9
drawer 8.9
oven 8.8
life 8.7
scene 8.7
tile 8.6
nobody 8.5
travel 8.4
eat 8.4
refrigerator 8.1
man 8.1
gate 8
night 8
departure 7.9
equipment 7.9
render 7.8
lunch 7.7
industry 7.7
apartment 7.7
expensive 7.7
relax 7.6
establishment 7.5
commercial 7.5
row 7.4
cook 7.3
meal 7.3
group 7.3
metal 7.2
working 7.1

Google
created on 2019-11-16

Photograph 95.6
Black-and-white 94.5
Snapshot 88.4
Monochrome 85.7
Monochrome photography 83.3
Photography 72.5
Room 71.4
Building 68.6
Sitting 54.1
Style 52.5

Microsoft
created on 2019-11-16

text 99.1
indoor 98.4
table 96.5
person 95.2
clothing 95.2
black and white 93.7
room 86.2
man 86
chair 79.2
white 77.6
black 65.4
restaurant 57.8
monochrome 51.3
bottle 50.3
furniture 39.6
cluttered 28.8

Face analysis

Amazon

AWS Rekognition

Age 22-34
Gender Female, 53.9%
Calm 47.6%
Happy 45.2%
Angry 45.1%
Disgusted 45%
Fear 45.3%
Sad 51.1%
Confused 45.5%
Surprised 45.1%

AWS Rekognition

Age 24-38
Gender Female, 53.4%
Confused 45.1%
Happy 47.8%
Disgusted 45%
Calm 45.9%
Angry 45.1%
Sad 46.8%
Surprised 45.2%
Fear 49%

AWS Rekognition

Age 12-22
Gender Male, 52.3%
Surprised 45.1%
Fear 45.7%
Angry 45.4%
Happy 45.1%
Sad 47.2%
Confused 45.1%
Calm 51.4%
Disgusted 45%

AWS Rekognition

Age 22-34
Gender Male, 50.1%
Confused 49.5%
Happy 49.5%
Disgusted 49.5%
Calm 49.7%
Angry 50.1%
Sad 49.6%
Surprised 49.5%
Fear 49.5%

AWS Rekognition

Age 23-37
Gender Male, 50.5%
Fear 49.6%
Disgusted 49.5%
Surprised 49.5%
Sad 49.9%
Happy 49.5%
Confused 49.5%
Angry 49.8%
Calm 49.6%

AWS Rekognition

Age 22-34
Gender Female, 50.3%
Disgusted 49.5%
Sad 49.9%
Calm 49.5%
Fear 49.7%
Happy 49.8%
Confused 49.5%
Angry 49.5%
Surprised 49.5%

AWS Rekognition

Age 22-34
Gender Female, 50.1%
Surprised 49.5%
Happy 49.5%
Confused 49.5%
Sad 50.1%
Angry 49.5%
Fear 49.5%
Disgusted 49.5%
Calm 49.8%

AWS Rekognition

Age 32-48
Gender Male, 50.5%
Fear 49.5%
Disgusted 49.5%
Calm 49.7%
Happy 49.8%
Surprised 49.5%
Angry 49.5%
Sad 49.9%
Confused 49.5%

AWS Rekognition

Age 29-45
Gender Male, 54%
Confused 45%
Calm 46.2%
Surprised 45%
Fear 45%
Happy 45%
Angry 45.2%
Sad 53.4%
Disgusted 45%

AWS Rekognition

Age 29-45
Gender Male, 50.3%
Sad 49.9%
Calm 49.6%
Angry 49.6%
Fear 49.9%
Happy 49.6%
Confused 49.5%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 22-34
Gender Male, 51.7%
Confused 45.2%
Fear 45.1%
Sad 54%
Disgusted 45%
Happy 45%
Angry 45.6%
Calm 45.1%
Surprised 45%

AWS Rekognition

Age 36-52
Gender Male, 50.3%
Happy 49.6%
Angry 49.7%
Disgusted 49.6%
Sad 49.6%
Surprised 49.5%
Calm 49.9%
Fear 49.5%
Confused 49.6%

Feature analysis

Amazon

Chair 99.8%
Person 99.4%

Captions

Microsoft

a black and white photo of a living room 86.3%
a black and white photo of a restaurant 86.2%
black and white photo of a living room 81%

Text analysis

Amazon

YT33A2
MJ13