Human Generated Data

Title

Untitled (advertising executives looking at poster)

Date

1951

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20144

Human Generated Data

Title

Untitled (advertising executives looking at poster)

People

Artist: Peter James Studio, American

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.4
Human 99.4
Sitting 99.4
Person 98.9
Person 98.7
Restaurant 98.3
Person 97.8
Cafe 89
Tie 89
Accessories 89
Accessory 89
Meal 79.3
Food 79.3
Cafeteria 78.5
Clothing 66.6
Suit 66.6
Apparel 66.6
Coat 66.6
Overcoat 66.6
Home Decor 62.9
Window 60.5
Monitor 59.3
Screen 59.3
Electronics 59.3
Display 59.3
Drink 56.5
Beverage 56.5
Food Court 55

Imagga
created on 2022-03-05

musical instrument 76.6
accordion 67.2
keyboard instrument 54.7
laptop 53.2
wind instrument 51.7
computer 45.1
business 40.7
man 38.3
businessman 37.1
office 35
male 33.3
person 31.6
people 31.2
working 30
adult 29.2
work 28.3
professional 27.7
businesswoman 26.4
teacher 26
corporate 24.9
meeting 21.7
executive 20
communication 19.3
technology 19.3
desk 18.9
job 18.6
room 18.4
bassoon 18.3
education 17.3
table 17.3
businesspeople 17.1
group 16.9
classroom 16.3
notebook 16.2
team 16.1
manager 15.8
suit 15.3
success 15.3
looking 15.2
smiling 15.2
educator 14.2
learning 14.1
student 14
sitting 13.7
men 13.7
teamwork 13
women 12.7
worker 12.5
indoors 12.3
conference 11.7
discussion 11.7
smile 11.4
happy 11.3
senior 11.2
study 11.2
home 11.2
hand 10.6
class 10.6
attractive 10.5
workplace 10.5
thinking 10.4
confident 10
holding 9.9
modern 9.8
handsome 9.8
cheerful 9.8
chair 9.7
corporation 9.6
diversity 9.6
sax 9.4
keyboard 9.4
casual 9.3
mature 9.3
successful 9.2
one 9
together 8.8
couple 8.7
employee 8.7
studying 8.6
talking 8.6
portrait 8.4
occupation 8.2
school 8.2
lady 8.1
paper 7.8
face 7.8
students 7.8
typing 7.8
colleagues 7.8
employment 7.7
monitor 7.7
boss 7.6
finance 7.6
career 7.6
showing 7.5
secretary 7.5
company 7.4
indoor 7.3
board 7.2
lifestyle 7.2
day 7.1

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

table 99.3
person 97.8
indoor 97.2
window 89.1
black and white 84
dish 79
text 67.3
working 66.6
people 65.8
counter 52.1

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 52.5%
Sad 38.9%
Calm 33.6%
Surprised 9.7%
Happy 5.2%
Confused 4.7%
Angry 3.6%
Disgusted 3.4%
Fear 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Tie 89%
Suit 66.6%

Captions

Microsoft

a group of people sitting at a table 97.5%
a group of people sitting around a table 97.2%
a group of people sitting at a table in front of a window 92.7%

Text analysis

Amazon

Herb
PM
AM
WJZ
WNEW-
Bob
arr
Ray
Bob Haynes
Herb Sheidon AM
Haynes
Sports
spoes
Music
Brown
Sheidon
WMSM-
Noves
WMSM- Tod Brown
WNEW- Flach
WOR-Moming
WOR-Moming Noves في spoes
Tod
DARK Cineron PM
V WNBC-Eco Ray Sott
Music Hall-Jory Mashell
WNBC-Eco
Mashell
في
Flach
YVMCA- The Date Sports
The
Cineron
VT37A2-XAOOX
V
YVMCA-
Sott
Date
DARK
Hall-Jory

Google

De
Haynes
WNBC
Sth
Herb
Cneron
Spots
WMCA-
Et
WNBC - Ece Ray Sth Haan WIZ Herb Sheidon AM De Cneron PM WOR Moming Nws Spots WMCA- T anl Spors WNEW- RytY Fct Et Haynes Muide ery Mestll WHGM- Erevy
WIZ
Moming
Mestll
WHGM-
-
Haan
Sheidon
AM
Nws
T
WNEW-
Muide
Ece
Ray
PM
WOR
anl
Spors
RytY
Fct
ery
Erevy