Human Generated Data

Title

Untitled (Hong Kong)
Date

March 3, 1960-March 13, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5391

Human Generated Data

Title

Untitled (Hong Kong)

People

Artist: Ben Shahn, American 1898 - 1969

Date

March 3, 1960-March 13, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5391

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Architecture 100
Building 100
Dining Room 100
Dining Table 100
Furniture 100
Indoors 100
Room 100
Table 100
Restaurant 100
Adult 98.9
Male 98.9
Man 98.9
Person 98.9
Home Decor 98.7
Linen 98.7
Person 98.5
Baby 98.5
Person 97.3
Adult 96.6
Male 96.6
Man 96.6
Person 96.6
Cafeteria 95.4
Tablecloth 95
Face 85.5
Head 85.5
Food 80.9
Food Court 80.9
Cafe 79.8
Clothing 78.3
Formal Wear 78.3
Suit 77.9
Adult 66.3
Person 66.3
Female 66.3
Woman 66.3
Meal 57.8
Diner 57.3
Flower 56.9
Flower Arrangement 56.9
Plant 56.9
Shirt 56.8
Sitting 56.1
Coat 56
Living Room 55.6
Glass 55.4

Clarifai
created on 2018-05-10

people 99.3
monochrome 99
man 97.6
adult 95
street 93.1
woman 93.1
furniture 92.6
group together 92.2
two 91.4
chair 91.2
group 88.6
room 85.6
restaurant 84.2
sit 81.7
one 81.6
portrait 79.7
black and white 78.9
wear 78.4
table 77.4
hotel 77.2

Imagga
created on 2023-10-06

man 49.1
male 42
people 37.4
business 34.6
waiter 34.5
businessman 34.4
meeting 33.9
person 33.8
office 33.4
adult 29.8
team 27.8
smiling 27.5
sitting 27.5
worker 27.4
table 27.2
men 25.8
happy 25.7
businesspeople 25.6
businesswoman 25.5
dining-room attendant 25.3
couple 25.3
colleagues 25.3
working 23.9
executive 23.8
employee 23.1
together 21.9
work 21.3
room 20.8
restaurant 20.6
indoors 20.2
talking 20
corporate 19.8
group 19.4
desk 19.2
mature 18.6
laptop 18.5
computer 17.7
suit 17.5
women 17.4
professional 16.6
discussion 16.6
20s 16.5
smile 16.4
home 16
senior 15.9
lifestyle 15.9
conference 15.6
portrait 15.5
teamwork 14.8
modern 14.7
30s 14.4
presentation 13
associates 12.8
coworkers 12.8
casual 12.7
communication 12.6
drink 12.5
cheerful 12.2
manager 12.1
attractive 11.9
holding 11.6
meal 11.4
looking 11.2
indoor 11
handsome 10.7
conversation 10.7
having 10.7
leader 10.6
coffee 10.2
camera 10.2
two 10.2
eating 10.1
food 10
confident 10
collaboration 9.8
discussing 9.8
40s 9.7
job 9.7
busy 9.6
wine 9.5
lunch 9.4
company 9.3
successful 9.2
hand 9.1
dinner 9.1
glass 9
technology 8.9
boardroom 8.9
four people 8.9
cooperation 8.7
mid adult 8.7
corporation 8.7
four 8.6
elderly 8.6
staff 8.6
twenties 8.6
friends 8.5
grandfather 8.2
romantic 8
clothing 7.9
paper 7.8
happiness 7.8
pretty 7.7
workplace 7.6
dining 7.6
enjoying 7.6
adults 7.6
horizontal 7.5
relaxed 7.5
new 7.3
counter 7.3
relaxing 7.3
color 7.2
bright 7.2
patient 7.1
love 7.1
day 7.1

Google
created on 2018-05-10

photograph 96.5
black 95.2
man 93
black and white 92.4
monochrome photography 84.7
photography 84.2
snapshot 81.8
sitting 81.5
male 79.9
gentleman 78.4
standing 75.4
conversation 73.6
communication 68.9
monochrome 68.8
table 67.4
human behavior 65.8
vintage clothing 58
stock photography 56.5

Microsoft
created on 2018-05-10

person 99.2
man 93.6
dish 43.4

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 60-70
Gender Male, 100%
Calm 98.5%
Surprised 6.4%
Fear 5.9%
Sad 2.3%
Happy 0.4%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 20-28
Gender Male, 79.2%
Calm 94.5%
Surprised 6.5%
Fear 6.3%
Sad 2.7%
Happy 1.7%
Disgusted 0.4%
Angry 0.3%
Confused 0.2%

Microsoft Cognitive Services

Age 81
Gender Male

Feature analysis

Amazon

Adult
Male
Man
Person
Baby
Suit
Female
Woman
Adult 98.9%
Adult 96.6%
Adult 66.3%
Male 98.9%
Male 96.6%
Man 98.9%
Man 96.6%
Person 98.9%
Person 98.5%
Person 97.3%
Person 96.6%
Person 66.3%
Baby 98.5%
Suit 77.9%
Female 66.3%
Woman 66.3%

Captions

Microsoft
created on 2018-05-10

a man sitting at a table 91.9%
a man standing in front of a table 91.5%
a man sitting on a table 84.6%