Human Generated Data

Title

Untitled (women at typewriters)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16665

Human Generated Data

Title

Untitled (women at typewriters)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Restaurant 99.2
Human 98.9
Person 98.9
Person 95
Person 94.5
Cafeteria 93.3
Cafe 91
Furniture 87.8
Chair 84.2
Person 80.4
Table 71.5
Indoors 69.8
Room 66.9
Flooring 61.7
Dining Table 61.5
Couch 59.9
Floor 59
Food 57.4

Imagga
created on 2022-02-26

shopping cart 71.7
handcart 57.8
wheeled vehicle 42.6
chair 37.4
room 31.9
table 29.7
container 28.6
interior 24.8
classroom 22.9
man 22.2
people 19.5
modern 18.9
business 18.8
indoors 18.4
shop 18.3
sitting 18
male 17.7
musical instrument 17
person 16.5
restaurant 16.2
office 15.5
house 15
furniture 14.4
home 14.3
conveyance 14.3
businessman 14.1
floor 13.9
women 13.4
barbershop 13
men 12.9
lifestyle 12.3
adult 12.2
group 12.1
percussion instrument 12
inside 12
style 11.9
teacher 11.7
building 11.6
working 11.5
chairs 10.8
design 10.7
computer 10.5
work 10.5
counter 10.5
laptop 10.1
communication 10.1
window 10.1
happy 10
kettle 10
student 10
kitchen 10
suit 9.9
cafeteria 9.7
couple 9.6
education 9.5
empty 9.4
meeting 9.4
decoration 9.4
architecture 9.4
light 9.4
relaxation 9.2
seat 9.1
students 8.8
cart 8.8
urban 8.7
class 8.7
device 8.7
corporate 8.6
dining 8.6
two 8.5
contemporary 8.5
learning 8.4
study 8.4
holding 8.2
indoor 8.2
technology 8.2
team 8.1
job 8
decor 8
smiling 8
together 7.9
happiness 7.8
boy 7.8
mercantile establishment 7.8
glass 7.8
luxury 7.7
exam 7.7
comfortable 7.6
elegance 7.6
wood 7.5
coffee 7.4
school 7.3
shopping 7.3
structure 7.3
businesswoman 7.3
sun 7.2
board 7.2
day 7.1

Google
created on 2022-02-26

Table 94.2
Furniture 93.8
Black 89.6
Chair 88.5
Window 88
Building 86.9
Black-and-white 86.3
Style 83.9
Monochrome 77.3
Tints and shades 76
Monochrome photography 75.4
Writing desk 72.1
Tableware 71.9
Room 70.8
Desk 68
Suit 66.6
Sitting 65.3
Art 61.9
Rectangle 60.8
Coffee table 58.6

Microsoft
created on 2022-02-26

text 96.8
indoor 95.1
black and white 95.1
furniture 93.8
person 91.6
window 91.4
chair 88.8
clothing 68.5
table 29.7
dining table 15.6

Face analysis

Amazon

Google

AWS Rekognition

Age 50-58
Gender Male, 99.1%
Calm 86.2%
Sad 10.4%
Confused 0.9%
Angry 0.9%
Disgusted 0.8%
Fear 0.3%
Surprised 0.3%
Happy 0.1%

AWS Rekognition

Age 27-37
Gender Female, 99.7%
Angry 44.9%
Calm 36.2%
Happy 6.7%
Confused 4.6%
Disgusted 3.6%
Sad 1.9%
Fear 1.2%
Surprised 0.9%

AWS Rekognition

Age 45-51
Gender Male, 64.6%
Calm 76.5%
Sad 22.1%
Confused 0.4%
Disgusted 0.3%
Happy 0.3%
Angry 0.2%
Surprised 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Chair 84.2%

Captions

Microsoft

a person sitting at a table in front of a window 71.1%
a man and a woman sitting at a table in front of a window 56.7%
a person sitting at a table in front of a window 56.6%

Text analysis

Amazon

avee
SS
KCDSK avee
KCDSK