Human Generated Data

Title

Untitled (man and woman in day clothes descending small staircase in fancy building)

Date

1948-1950

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9293

Human Generated Data

Title

Untitled (man and woman in day clothes descending small staircase in fancy building)

People

Artist: Martin Schweig, American 20th century

Date

1948-1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9293

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 96.3
Apparel 96.3
Person 96.1
Human 96.1
Person 94.9
Person 94.5
Person 94.2
Person 91.8
Banister 81.5
Handrail 81.5
Overcoat 76.3
Coat 76.3
Suit 70.1
Tie 64.6
Accessories 64.6
Accessory 64.6
Staircase 60.6
Sleeve 55.3

Clarifai
created on 2023-10-26

people 99.8
monochrome 97.9
adult 97.4
step 97
woman 97
group 96.8
two 96.7
man 95.9
administration 95.9
indoors 94
room 92.8
leader 92.8
three 91.9
furniture 90.5
wear 87.6
home 85.9
group together 85.1
one 84.5
four 83.5
several 83.4

Imagga
created on 2022-01-23

business 35.8
male 33.3
businessman 32.7
man 32.2
office 32.2
people 30.7
corporate 29.2
adult 26.5
person 25
suit 22.3
professional 21.7
musical instrument 19.6
executive 19.3
building 19
men 18.9
wind instrument 18.1
meeting 17
happy 16.9
businesswoman 16.4
room 16.3
group 16.1
indoor 15.5
looking 15.2
job 15
women 15
brass 15
indoors 14.9
work 14.1
modern 14
life 13.8
handsome 13.4
businesspeople 13.3
desk 13.2
worker 12.7
attractive 12.6
team 12.5
manager 12.1
mature 12.1
success 12.1
black 11.5
smile 11.4
career 11.4
standing 11.3
education 11.3
pretty 11.2
sitting 11.2
laptop 11
portrait 11
classroom 11
confident 10.9
couple 10.5
teamwork 10.2
day 10.2
casual 10.2
two 10.2
communication 10.1
successful 10.1
employee 9.9
outfit 9.8
fashion 9.8
colleagues 9.7
boss 9.6
table 9.5
tie 9.5
sax 9.3
teacher 9.2
occupation 9.2
holding 9.1
cheerful 8.9
computer 8.9
40s 8.8
hall 8.7
smiling 8.7
corporation 8.7
diversity 8.6
chair 8.6
happiness 8.6
adults 8.5
senior 8.4
company 8.4
device 8.2
architecture 8.1
interior 8
lifestyle 7.9
urban 7.9
businessperson 7.8
speaker 7.8
confidence 7.7
formal 7.6
finance 7.6
thinking 7.6
inside 7.4
student 7.3
alone 7.3
color 7.2
face 7.1
working 7.1
travel 7
together 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

man 94.6
clothing 93.8
black and white 92.6
person 91.1
text 80.2
monochrome 58.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 100%
Calm 84.2%
Surprised 13.5%
Happy 0.8%
Sad 0.5%
Confused 0.4%
Disgusted 0.3%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Male, 95.1%
Calm 60.6%
Sad 11.5%
Disgusted 7.5%
Happy 7.1%
Surprised 6.9%
Confused 4.2%
Angry 1.2%
Fear 0.9%

AWS Rekognition

Age 25-35
Gender Female, 93.1%
Calm 52%
Sad 24.8%
Fear 10.9%
Confused 7.4%
Happy 1.8%
Angry 1.7%
Disgusted 0.8%
Surprised 0.6%

AWS Rekognition

Age 40-48
Gender Male, 96%
Fear 98.2%
Sad 0.6%
Disgusted 0.5%
Calm 0.3%
Angry 0.2%
Happy 0.1%
Confused 0.1%
Surprised 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.1%
Suit 70.1%
Tie 64.6%

Categories

Captions

Text analysis

Amazon

MANDARIN
ROOM
WALNUT
FIRST
WALNUT ROOM
FIRST FLOOR
VERSAILLES ROOM
TAP
TAP ROOM
FLOOR
VERSAILLES
MARINE
PULL
MANDARIN ROOM 1
1

Google

MARINE ROOM ROOM
ROOM
MARINE