Human Generated Data

Title

Untitled (guests at cocktail party)
Date

1952
People

Artist: Peter James Studio, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20179

Human Generated Data

Title

Untitled (guests at cocktail party)

People

Artist: Peter James Studio, American

Date

1952

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20179

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.9
Apparel 99.9
Overcoat 99.6
Coat 99.6
Person 99
Human 99
Person 98.4
Person 98.4
Person 96.4
Person 96.3
Suit 96.2
Tuxedo 95.2
Person 95
Person 91.5
Person 91
Tie 90.3
Accessories 90.3
Accessory 90.3
Suit 89.3
Blazer 87
Jacket 87
Person 83.7
Sunglasses 83.2
Tie 81.4
Person 79.3
Shirt 77.3
Sunglasses 68.7
Text 68.5
People 64.8
Dress 62.9
Man 62.8
Female 56.4
Sleeve 56.2
Pedestrian 55.1

Clarifai
created on 2023-10-22

people 99.8
group 99.4
group together 99.3
man 98
adult 96.6
woman 95.3
several 93.5
five 93.5
leader 92.5
four 90.9
three 89.1
monochrome 88.9
administration 88.8
many 85
indoors 82.6
actor 81
handshake 78
street 77.8
music 76
meeting 75.3

Imagga
created on 2022-03-05

businessman 50.4
man 49.8
business 48.6
team 48.4
professional 47.8
office 47.6
male 47.6
corporate 47.3
teamwork 42.7
meeting 42.4
people 40.7
suit 40
success 39.5
happy 38.2
executive 37.4
building 34.9
successful 32.1
men 30.1
manager 29.8
worker 29.8
job 29.2
person 29.2
businesswoman 29.1
work 29.1
groom 28.7
group 28.2
partnership 27.9
adult 27.4
attractive 27.3
businesspeople 26.6
handsome 25.9
entrepreneur 24.3
working 23.9
occupation 23.8
smile 23.5
company 23.3
diversity 23.1
partner 22.2
smiling 21.7
ethnic 20.9
life 20.6
colleagues 20.4
workplace 20
portrait 19.4
career 18.9
handshake 18.6
confident 17.3
pretty 16.8
standing 16.5
employment 16.5
leadership 16.3
modern 16.1
communication 16
hands 15.6
consultant 15.6
boss 15.3
employee 15
diverse 14.7
women 13.5
looking 12.8
agreement 12.6
black 12
expression 11.9
two 11.9
shaking 11.8
coworkers 11.8
businessmen 11.7
corporation 11.6
lifestyle 11.6
skill 11.6
talk 11.5
talking 11.4
laptop 10.9
foreman 10.9
staff 10.7
architect 10.6
helmet 10.6
doctor 10.3
builder 9.8
human 9.8
discussion 9.7
contractor 9.7
clothing 9.7
attendant 9.7
leader 9.6
together 9.6
education 9.5
development 9.5
tie 9.5
happiness 9.4
industry 9.4
site 9.4
architecture 9.4
casual 9.3
finance 9.3
greeting 9.3
teacher 9.3
secretary 9.2
friendly 9.2
hand 9.1
engineer 9
cheerful 8.9
expert 8.9
medical 8.8
shake 8.8
conference 8.8
urban 8.7
couple 8.7
designer 8.7
formal 8.6
hospital 8.6
engineering 8.6
construction 8.6
mature 8.4
medicine 7.9
associate 7.9
bright 7.9
guy 7.9
plans 7.9
day 7.8
director 7.8
structure 7.8
face 7.8
table 7.8
40s 7.8
deal 7.8
workers 7.8
cooperation 7.7
pointing 7.7
confidence 7.7
commerce 7.5
holding 7.4
care 7.4
garment 7.3
20s 7.3
indoor 7.3
lady 7.3
computer 7.2
look 7

Google
created on 2022-03-05

Suit trousers 96.8
Trousers 96.7
Photograph 94.2
White 92.2
Coat 87.1
Black-and-white 85.6
Style 84
Suit 79.5
Tie 79.1
Blazer 78.3
Eyewear 76.5
Snapshot 74.3
Formal wear 74
White-collar worker 72.8
Event 72.5
Monochrome 72.4
Monochrome photography 72.2
Backpack 71.5
Fashion design 70.2
Luggage and bags 65.7

Microsoft
created on 2022-03-05

person 99.2
clothing 97.7
standing 95.7
suit 92.4
man 90.9
text 89.6
black and white 86.8
woman 72.8
smile 65.9
posing 61.4
clothes 18.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Male, 62.7%
Calm 98.6%
Sad 0.3%
Surprised 0.3%
Disgusted 0.3%
Happy 0.2%
Confused 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 45-51
Gender Female, 81.8%
Happy 74.2%
Calm 12.8%
Sad 9.9%
Confused 1.3%
Fear 0.7%
Disgusted 0.5%
Surprised 0.5%
Angry 0.2%

AWS Rekognition

Age 50-58
Gender Male, 100%
Happy 98.5%
Calm 0.4%
Angry 0.4%
Surprised 0.3%
Confused 0.2%
Disgusted 0.1%
Fear 0.1%
Sad 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person
Suit
Tie
Sunglasses
Person 99%
Person 98.4%
Person 98.4%
Person 96.4%
Person 96.3%
Person 95%
Person 91.5%
Person 91%
Person 83.7%
Person 79.3%
Suit 96.2%
Suit 89.3%
Tie 90.3%
Tie 81.4%
Sunglasses 83.2%
Sunglasses 68.7%

Categories

Imagga

people portraits 75.3%
events parties 24%

Text analysis

Amazon

KODAK-SEELA

Google

YT37A2- AGON
YT37A2-
AGON