Human Generated Data

Title

Untitled (three men in front of chalkboard)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16568

Human Generated Data

Title

Untitled (three men in front of chalkboard)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-12

Person 99.7
Human 99.7
Person 99.7
Person 99.6
Apparel 95.9
Clothing 95.9
Flooring 91
Floor 87.9
Text 86
Shorts 84.4
Indoors 82.3
Wood 76.5
Furniture 76.4
Sleeve 73.5
Female 72.2
Chair 63.5
Long Sleeve 63.3
Photography 63.3
Photo 63.3
Portrait 62.5
Face 62.5
People 60.2
Room 60.1
White Board 58.1
Plywood 57.4
Building 56.7
Office Building 56.7
Suit 56.6
Overcoat 56.6
Coat 56.6

Imagga
created on 2022-02-12

business 35.2
man 33.6
male 33.3
office 33.1
people 31.8
corporate 31.8
women 31.6
businessman 29.1
person 28.2
group 26.6
team 26
businesswoman 25.4
work 25.3
professional 25.3
happy 24.4
men 24
blackboard 23.6
meeting 23.5
executive 23.4
building 23.3
room 22.9
adult 21.5
job 21.2
manager 20.5
modern 20.3
success 20.1
worker 19.6
teamwork 19.5
portrait 16.8
company 16.7
successful 16.5
suit 16.3
pretty 16.1
interior 15.9
hall 15.5
attractive 15.4
boss 15.3
classroom 15
table 14.8
teacher 14.6
lifestyle 14.5
smile 14.2
two 13.6
hospital 13.4
standing 13
employee 12.9
chair 12.8
conference 12.7
communication 12.6
ethnic 12.4
career 12.3
indoors 12.3
colleagues 11.7
smiling 11.6
black 11.4
talking 11.4
human 11.2
casual 11
laptop 10.9
diversity 10.6
together 10.5
businesspeople 10.4
walking 10.4
inside 10.1
student 10.1
desk 9.6
indoor 9.1
diverse 8.8
architecture 8.8
couple 8.7
partner 8.7
hands 8.7
partnership 8.6
nurse 8.6
sitting 8.6
presentation 8.4
holding 8.3
life 8
home 8
working 8
handshake 7.8
airport 7.8
education 7.8
agreement 7.8
center 7.6
finance 7.6
hand 7.6
smart 7.5
silhouette 7.4
window 7.3
day 7.1

Google
created on 2022-02-12

Furniture 92.9
Black-and-white 85.3
Gesture 85.3
Style 83.9
Chair 79.5
Font 78.5
Art 76.9
Monochrome photography 74.9
Monochrome 74.9
Automotive design 74.6
Event 71.1
Rectangle 70.2
Visual arts 67.7
Room 67.1
Flooring 64.8
Sitting 59.1
Advertising 55.3
T-shirt 52.2

Microsoft
created on 2022-02-12

building 99.3
text 95.7
outdoor 92.9
clothing 89.6
standing 85.1
man 84.9
black and white 76.9
person 76
furniture 68.1
chair 67.3
street 66.6
handwriting 57.5

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Male, 99.1%
Calm 93.9%
Happy 1.8%
Sad 1.4%
Confused 1.1%
Surprised 0.7%
Disgusted 0.6%
Fear 0.3%
Angry 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Chair 63.5%

Captions

Microsoft

a man standing in front of a building 77.5%
a group of people standing in front of a building 74.3%
a man and a woman standing in front of a building 58.5%

Text analysis

Amazon

BAK
SLEAVE
WASTE
BAK 2'7"
2'7"
SLEAVE 2'8"
6
2'8"
WASTE Он Not
Not
Он

Google

WASTE
SLEAVE
27"
NO!
SLEAVE 2'8" BAK 27" WASTE OH NO!
OH
BAK
2'8"