Human Generated Data

Title

Untitled (man posed seated with young boy and two old men holding dogs)
Date

1943
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9046

Human Generated Data

Title

Untitled (man posed seated with young boy and two old men holding dogs)

People

Artist: Martin Schweig, American 20th century

Date

1943

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9046

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 97.7
Person 97.5
Person 97.1
Person 96.2
Person 94.8
Clothing 93.4
Apparel 93.4
Tie 90.7
Accessories 90.7
Accessory 90.7
Doctor 69
Face 67.7
Clinic 64.1
Portrait 64.1
Photography 64.1
Photo 64.1
Finger 60.7
Door 57.5
Coat 57.3
Sleeve 56.8
Sailor Suit 56.3

Clarifai
created on 2023-10-27

people 99.3
man 98.6
group 98.3
uniform 97.7
adult 96.5
doctor 94.2
group together 91.1
hospital 88.9
portrait 88.9
healthcare 85.5
medicine 85
monochrome 84.8
leader 81.5
three 81.1
medical practitioner 80.5
veil 80.2
outfit 79.5
partnership 78.7
outerwear 76.6
business 76.3

Imagga
created on 2022-01-23

lab coat 100
coat 100
doctor 60.2
nurse 53.5
man 51.1
garment 49.9
medical 49.5
hospital 47.4
male 44
professional 41.7
medicine 39.7
clinic 37.8
team 35.9
person 33.8
specialist 33.5
health 33.4
stethoscope 33.1
occupation 32.1
adult 31.7
care 31.3
people 31.3
job 31
doctors 30.5
clothing 29.9
uniform 29.5
happy 29.5
business 27.4
smiling 26.8
practitioner 26.6
work 25.9
portrait 25.3
mature 25.1
businessman 23.9
looking 23.2
worker 22.5
office 22.5
colleagues 22.4
30s 22.1
working 22.1
clinical 21.5
smile 20.7
men 20.6
teamwork 20.4
confident 20
patient 19.8
group 19.4
profession 18.2
handsome 17
standing 16.5
laboratory 16.4
staff 16.3
elderly 15.3
businesspeople 15.2
indoors 15
indoor 14.6
consultant 14.6
40s 14.6
expertise 14.6
illness 14.3
senior 14.1
lifestyle 13.8
women 13.5
corporate 12.9
color 12.8
two 12.7
practice 12.6
surgeon 12.4
cheerful 12.2
bright 12.2
success 12.1
casual 11.9
general practitioner 11.9
businesswoman 11.8
associates 11.8
coworkers 11.8
happiness 11.8
mid adult 11.6
face 11.4
meeting 11.3
camera 11.1
20s 11
friendly 11
student 10.9
look 10.5
attractive 10.5
human 10.5
healthy 10.1
successful 10.1
clinician 9.9
heal 9.8
healing 9.8
diagnosis 9.8
physician 9.8
health care 9.7
2 9.7
partnership 9.6
couple 9.6
exam 9.6
confidence 9.6
desk 9.5
day 9.4
treatment 9.2
suit 9
lady 8.9
expert 8.9
crew 8.9
discussing 8.9
good mood 8.8
50s 8.8
medication 8.8
together 8.8
ill 8.8
thirties 8.8
assistant 8.8
examination 8.8
workers 8.7
cooperation 8.7
sick 8.7
four 8.6
tie 8.5
horizontal 8.4
fifties 7.9
black 7.8
discussion 7.8
table 7.8
lab 7.8
partner 7.7
busy 7.7
modern 7.7
diversity 7.7
holding 7.4
light 7.4
computer 7.2

Google
created on 2022-01-23

Clothing 98.7
Outerwear 95.2
Smile 89.8
Sleeve 87.1
Coat 86.6
Style 83.9
Black-and-white 83.9
People 78.4
Service 75.2
Snapshot 74.3
Monochrome photography 72
Formal wear 72
Event 71.3
White coat 71.2
Monochrome 69.1
Uniform 65.5
Vintage clothing 64.7
Fashion design 64.5
Eyewear 63.9
White-collar worker 63.7

Microsoft
created on 2022-01-23

wall 99.3
text 98.6
man 96.6
person 92.4
posing 85.3
clothing 84.4
wedding 81.7
smile 76.5
human face 67.3
ceremony 63.4
old 46.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 14-22
Gender Male, 99.4%
Surprised 82%
Calm 8.8%
Happy 3%
Fear 2.9%
Sad 1.8%
Disgusted 0.9%
Angry 0.4%
Confused 0.2%

AWS Rekognition

Age 53-61
Gender Male, 99.6%
Calm 48.5%
Happy 43.3%
Surprised 5.4%
Angry 0.7%
Confused 0.7%
Sad 0.6%
Disgusted 0.6%
Fear 0.2%

AWS Rekognition

Age 51-59
Gender Male, 99.8%
Calm 37.1%
Surprised 22.6%
Happy 18.3%
Confused 10.9%
Sad 6.8%
Fear 1.9%
Disgusted 1.3%
Angry 0.9%

AWS Rekognition

Age 45-53
Gender Male, 99.7%
Surprised 66.2%
Calm 24.2%
Happy 3.3%
Sad 3.3%
Confused 1.2%
Disgusted 0.8%
Angry 0.6%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Person 97.5%
Person 97.1%
Person 96.2%
Person 94.8%
Tie 90.7%

Categories

Imagga

people portraits 95.8%
paintings art 2.9%

Captions

Microsoft
created by unknown on 2022-01-23

a group of people posing for a photo 95.4%
a group of men posing for a photo 95.3%
a group of people posing for the camera 95.2%

Text analysis

Amazon

32AB
32AB YT3RAS R30H3330
YT3RAS
R30H3330

Google

22A0 YT3RA2 R30M3330
22A0
YT3RA2
R30M3330